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Summary. The “goodness of fit” problem, consisting of comparing the empir- 
ical and hypothetical cumulative distribution functions (cdf’s), is treated here 
for the case when an auxiliary parameter is to be estimated. This extends the 
Cramér-Smirnov and von Mises test to the parametric case, a suggestion of 
Cramér [1], see also [2]. The characteristic function of the limiting distribution 
of the test function is found by consideration of a Guassian stochastic process. 


1. Introduction; position of the problem. Let X,, X2, --- , X, be independent 
observations (random variables) coming from a population whose absolutely 
continuous cdf is G(x). Let J be a nondegenerate interval on the real axis and 
suppose, for each & contained in the interior of J, that F(x; &) is a edf. In this 
paper we treat the problem of testing the hypothesis H, 


(1.1) H : G(x) = F(z; €) for some unspecified Ee I. 


About the only test of H at present available seems to be the usual x’ test, 
discussed recently by Cochran [3]. 
For a somewhat different hypothesis H, , 


(1.2) Ho : G(x) = F(x) = F(z; &) for a specified & € I, 


the following test of Cramér [2], Smirnov [4], and von Mises [5] is available. 
Let F(x) be the empirical cdf of the data; that is, F,(z) = k/n if k of the X;, 


with 7 = 1, 2, --- , n, are less than xz, for —~ < x < om. The test function 
is then 
(1.3) Wr =n] (Pal) — Fle; tel aF(x; be), 


and Hy, is rejected if W% is suitably large. The limiting distribution of W% , 
if Ho is true, was given by Smirnov; it has been tabulated recently [6]. 

This test of Hy has certain attractive properties not possessed by the usual 
x’ test. It does not require a subjective grouping of the data into classes, it is 
distribution free for all n (if Ho is true), and it is consistent (i.e., has limiting 
power 1). Appraisals of the x’ test and this test are given by Cochran [3] and 
Birnbaum [7]. 

In an effort to modify the W%, test to treat the hypothesis H of (1.1), we shall 
consider, following a suggestion of Cramér, the test function 


(1.4) CL=n r. [F,(z) — F(z; 6,))° dF (2; 6,), 
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where 6, is a suitable estimator for the unknown parameter ¢ in F(x; £), and is 
a function of X;, X:,--- , X,. The hypothesis H is to be rejected if C%, is suffi- 
ciently large. If Xi, X:,---,Xe isa rearrangement of the sample X;, X:2, 
--+, X, so that Xi < X; < --- < X4, for computational purposes C%, can be 
expressed more simply as 


ce ‘ ra, 4-17 
(1.5) C=-p+ 3 | rex i) — +, |. 

The main analytical task is to calculate the distribution of C%, when H is true; 
it is accomplished in the present paper. It turns out that matters depend cru- 
cially on the estimator 6, chosen. There are two essentially distinct cases. 

If it happens that, among other conditions stated in Theorem 2.1, 6, is an 
estimator such that nE{(6, — @)*} 0, where @ is the true value of £, that is, 
G(x) = F(z; @), then the limiting distribution of C% is the same as the limit- 
ing distribution of W% given by (1.3). This is known and tabulated. 

In the more general case when @ does not admit this so-called superefficient 
estimate but »/n(6, — @) has a limiting Gaussian distribution with mean 0 
and variance o > 0, then the limiting distributions of C*, and W%, are not the 


1 
same; the limiting distribution of C% is that of I Y°(t) dt, where Y(é) is a cer- 
0 


tain Gaussian stochastic process. The process has a specially simple structure if 
6 admits a minimum variance (or efficient) estimator 6, , or if the maximum likeli- 
hood estimator is asymptotically efficient in the sense of Cramér [1]. 

In this latter case, we determine the ch.fn. of the limiting distribution of 
C*, explicitly. We give several illustrations, but unfortunately even in simple, 
important cases (such as, a normal distribution with an unknown mean) the 
resulting ch.fn. appears very difficult to invert. 

Unlike the W’%, test, the C%, test is not distribution free. In general it depends 
on the unknown true value of é, though in important special cases (including 
the case when ¢ is a scale or location parameter) the asymptotic test depends 
only on the structure of the family F(z; §) and not upon the particular value 
of obtaining; that is, the test is parameter-free, so to speak. 


2. The superefficient case. Suppose that H as given by (1.1) is true, and let 
the true unknown value of the parameter ¢ be 0, with @ an interior point of J. 
Let the density corresponding to F(x; &) be f(z; £). Denote as before 


i ar (F(x) — F(x; 6))? F(x; 6) = W2. 


THEOREM 2.1. Assume that the estimator 6, and the distribution F(x; &) have the 
following properties: 

1) nE{(6, — 0)°} ~0,n— ~; 

2) For , ¢’eI, F(x; &) satisfies a Lipschitz condition 


| Fw; &) — F@; &)| < A@) |& — |, 
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where Pr{A*(X:) > Ao} = 0 for some Ay < ©, the probability according to 
F(z; 6). 

Then C*, = W*, + bn, where 5, —> 0 in probability. 

Proor. From (1.5) 


= ae tb (Peas) - 4) 


zs” 


C 


-mt > ({ rex: ; 0) -i=}} + {F(X} ; 6.) — F(X; o}) 


=W.+2 {Hx, : 6) -i-}\ (F(X; ; 6.) — F(X}; 6)} 


+ Do {F(X}; 6.) — F(X; ; 6}? 
= Wi + 26: + &. 
Then 6; S (W%, — 1/12n)é:, and 
bo = >> (F(X; ; 6.) — F(X}; 0)}? < n(6, — 6)* max; A?(X;). 


Thus E(é.) — 0 and E(8i) S$ E{(W% — 1/12n)*}'E(83)"” — 0, and the theorem 
follows. A trivial consequence of the theorem is 

CoroLuary 2.1. Under the conditions 1) and 2) of Theorem 1.1, the limiting 
distribution of C%, is the same as that of the von Mises statistic W’%, . 

The limiting distribution of W%, has been tabulated [6]; the problem in this 
case is solved. Two simple examples in which the estimate 6, is unbiased follow. 

a.) It is easily verified that Var(é,) = @/n(n + 2), and that condition 2) 
of Theorem 1.1 is satisfied, when 


I= {t|0<i <t < @}; ft, O<a4<é 
jess) = | 


hm a * max pe he ed 0, otherwise; 


b.) Likewise, Var(6,) = k/2(n + 1)(n + 2), and 2) is satisfied by f(z; £), 
when 
I= {§|-2 <i < @}; 
6, = (U + V). 


Here U is the kth largest X,; and V is the kth smallest X;, fori = 1, 2, --- n, 
and k is independent of n (e.g., k = 1 gives 6, the midrange). 


, §-}<2<t+4+}, 
fed = |) ae 


, otherwise; 


3. The regular estimation case. In general, the rather rapid decrease of 
Var(6,) to zero as expressed by condition 1) of Theorem 1.1 will not occur. In 
the case of regular estimation of Cramér ([1] p. 477), we will have Var(6,) > A/n 
for some positive A—the Cramér-Rao inequality. But it will generally happen 
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that n“’?*(6, — @) will converge in probability to zero for 6 > 0. To cover this 
situation, we have the following 
Lemma 3.1. Assume that f(x; £) and 6, are such that 


1) nE{ (6, - @)*} ~>@, 


d° F(z; €) 
2) | | < go(x), 


| Of(z; &) | 
3) | ae | < gi(x), 
for almost all x, where go and g; are integrable from —« to +. The functions 


go and g; and the exceptional set do not depend on &. 
Then, 


(3.1) CL=n t (Fa) — F(x) — (6, — 8) SFr; a} sles 6 dz + bn, 


where 6, — 0 in probability. 
For almost all x we have 


F(x; 6,) = F(x; 6) + (6, — 4) = F(x; 0) + $(6, — 9)°qogo(z), |go| <1; 


f(x; 6n) = f(x; 0) + (6, — O)qigi(x), la| <1. 


Putting these expansions in expression (2.1), we obtain the lemma after some 
calculations. 
Conditions 2) and 3) in the above lemma could be replaced by the condition, 


similar to that of Theorem 2.1, 
|OFX;§) _ dF(X; 2%’) | 
ee <= et. 


Thus it is necessary to study only the limiting form (if it exists) of the distribu- 
tion of 


2 a 2 
Ri =n [ { Fala) — F(x;0) — (6, — 0) reso} f(x; 0) dx. 


A transformation which is basic in the work to follow, 
(3.2) u = F(z; 6), 


defines implicitly z as a function of wu. Thus x = 2x(u; 6) except possibly for an 
enumerable set of u values at which x can be defined arbitrarily, except to render 
it monotone nondecreasing. Next we define the function g(u) as 


(3.3) gu) = < F(a; 6), 
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and note that g(u) depends in general on @. Finally, we express the empirical 
cdf as a function of u. If we introduce the function y,(v) defined as 
a eat’ 
¥(v) is 
0, v = t, 


then we have, with probability one, 


Fy(z) = 2 2 valX) = 2D valPCXs 50), 


where wu is given by (3.2.). On writing 


Cc’, can be written, from (3.1), as 
* oh 
Ca = | (Za(u) — Trg(u))? du + 6, 
0 


where 6, — 0 in probability, and g(u) is given by (3.3). Finally by defining the 
stochastic process Y,(u) as 


(3.6) Y,(u) = Z,(u) — Trg(u) 
where Z,(u) and 7’, are given by (3.4) and (3.5), and g(u) by (3.3), we have 


1 
C= [ Y2(u) du + 6, 
0 


where 6, — 0 in probability. 

It follows that the limiting form of the stochastic process Y,(u) is of central 
importance, and we next prove 

LemMa 3.2. Assume, in addition to conditions 1), 2), 3) of Lemma 3.1, that 

4) nE(6, — 0) > 0; 

5) T, = Vn(b, — 0) is a sum of independent identically distributed random 
variables having a limiting Gaussian distribution with variance o° > 0; and 

6) the conditional expectation nuE(6, — @| F(X1; 0) < u) converges to a func- 
tion h(u) withO < u < 1 and h(O) = A(1) = 0. 

Then the process Y,(u) converges in distribution to a Gaussian process Y (u) 
with mean 0 and covariance 


p(u,v) = E(Y(u)Y(v)) 
= min (u,v) — w — g(u)h(v) — g(v)h(u) + o°g(u)g(v). 


The expression “Y,(u) converges to Y(u) in distribution” means that for 
every finite set 1, U2, --- , Um the joint cdf of Y,(w), Yn(ue), --- , Yu(ue) 
converges to the joint cdf of Y(w), Y(ue), --- , Y(u). The proof of the lemma 


(3.7) 








6 D. A. DARLING 


is quite straightforward. The process Z,(u) defined by (3.4) is known to con- 
verge in distribution to a Gaussian process with mean 0 and covariance k(u, v) = 
E(Z,(u)Z,(v)) given by 


(3.8) k(u, v) = min (u, v) — w, 


with k(u, v) being independent of n (see, for example, [6]). By 5) 7’, has a limit- 
ing Gaussian distribution with mean 0 and variance o’. It follows from the multi- 
dimensional central limit theorem that the linear combination Y,(u) = Z,(u) — 
T,.g(u) converges in distribution to a Gaussian process whose mean is 0. Thus 
will be sufficient to verify that the limiting covariance p,(u, v) = E(Y,(u)Y,(v)) 
converges to p(u, v) given by (3.7). 

Denoting by h,(u) the function 


(3.9) ha(u) = E(Z,(u)T.) 
and using (3.4) and (3.5), we have, by condition 5), 
hau) = VnE{[(1/n) do yulF(X; ; 8) — ulln(6, — 9))} 
= L Ely.(F(X; ; 8))(bn — 0)] — nub, — 6) 
nE{ (6, — O)Wu(F(X: ; 8))} — nuE(6, — 4) 
nuE{\6, — @| F(X1; 0) < u} — nuE(6, — 8). 


Consequently by 4) and 6), ha(u) — h(u) for 0 S u S 1. The covariance p,(u, v) 
is 


(3.10) 


gary Pe?) = BlZaCu) — Tao w)llZalo) — Toole) 
k(u,v) — ha(ulgv) — halv)g(u) + ong(u)g(), 


where o, = Var(T,) > o and k(u, v) is given by (3.8). Thus we obtain p,(u, v) > 
p(u, v) for p(u, v) as in (3.7), and the lemma is established. 
It might be concluded that the limiting distribution of C%, is the distribution 


1 
of C* = [ Y*(u) du where Y(u) is a Gaussian process with mean 0 whose co- 
0 


variance is given by (3.7), following Doob’s [8] heuristic approach. But we shall 
prove this fact in the next section only when the estimator 6, is further specialized. 

Two further properties of the function h,(u) conclude this section. 

Lemma 3.3. For the function h,(u) as defined by (3.9), 

1) | Aa(u) | S onV/ul — 4), 

2) hu(u) = nE{6, — 6| F(X1; 6) = u} — nE(6, — 8). 

The first relation follows immediately by Schwarz’ inequality from (3.9) by 
using (3.8) with u = v and Var(T,,) = o% . For the second relation we use (3.10) 
to give 
ha(u + 6) — ha(u) = ndE{(6, — 0) | [u < F(X1; 0) Sut dj} — ndE{6, — 6}. 
By letting 6— 0, 2) follows. 
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For n > «, h,(u) converges to h(u) and a; converges to o. Thus we have 
| h(u) | < ovV/u(l — u). However, we cannot conclude directly that lim h,(u) 
exists. 


4. Case of an efficient estimator. As yet, we have given no special attention 
to the choice of the estimator 6, . It might be thought that, paralleling the prin- 
ciple of minimum x’, we should choose 6, so as to make C%, , as given by (2.1), a 
minimum. However, as is often the case with minimum x’, this does not lead to 
usable results. However, precisely as in the x’ case, the maximum likelihood 
principle does lead to a certain ideal properties for C%, , at least asymptotically. 

In this section, we assume that Cramér’s conditions ({1], pp. 477-489) for a 
regular, unbiased efficient (or minimum variance) estimate are satisfied. Follow- 
ing Cramér, we simply term the estimate efficient. Then all the conditions 1) 
through 6) of Lemma 3.2 are satisfied, as noted below, with the possible excep- 
tion of condition 2), which we shall further presume satisfied. Condition 2) is 
also postulated by Cramér for the maximum likelihood case which we consider 
in the next section. The efficient estimator is unbiased so that condition 4) is 
satisfied, and implies besides that the likelihood function 


b= T4589 


has the property that if £ = 6, is a root of (0/d£) log L = 0, then, defining 


(41) o = vei| 2 log X30) ]} = ([- E log ses 0) | $03) ax) 


we have 

0 “~ 9 n 

xg BL = 25 log (X58) = 5 — 8). 
By putting § = @, this yields 


(42) * by — 0) = A tog (X30) = VP 7. 


It then follows that the variance of 7, is o’, independent of n, given by (4.1), 
and that conditions 5) and 6) are satisfied. 

For condition 7) of Lemma 3.2, we multiply through the last equality by 
o and take conditional expectations of both sides under the condition that 
F(Xi; 6) = wu. Then on using 2) of Lemma 3.3, and the fact that 
E{(a/00) log f(X; ; 6)] = 0, we have 


’ hi(u) = tO BS log Xs50)| X50) = ub 


2 a ° ° = 
0843 log (Xs 50) | Ks 0) = ub 


o* = log f(x; 6), 
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using transformation (3.2). Thus h,,(u) is independent of n. We denote it by 
h’(u), given by 


(4.3) h'(u) =o? < log f(z; 6). 


Because of this simple formula for h(u), making it proportional to g(u) as we 
see immediately, p(w, v) simplifies and renders the process Y(u) of Lemma 3.2 
manageable. 

From the definition of g(u) in (3.3) we have immediately g(0) = g(1) = 0 
and 


1 @ 
~ F(x; 0) 80 


Since h(0) = 0 by 1) of Lemma 3.3, by integrating we obtain h(u) = og(u). 
Thus it follows that we can define a function ¢(u), 


h(u) _ 


gu) = Sle; 0) 5 fe; 8) = log fx; 0) = = W'(u). 


(4.4) g(u) = og(u), 
where h’(w) is given by (4.3) and g(u) by (3.3), o being given by (4.1) and x by 
(3.2). 

Putting these values for h(u) and g(u) in (3.11), we obtain 

Lemma 4.1. In the case of an efficient estimator, the process Y,(u) given by (3.6) 
has mean 0 and covariance 


(4.5) p(u, v) - k(u, v) ~~. ¢(u)e(v), 
independent of n, where k(u, v) is given by (3.8) and g(u) by (4.4). The function 
¢g(u) has the properties 
al 
a) |¢(u)| S$ Vu — u), b) | ¢*(u) du = 1 
0 


Condition a) follows from 1) of Lemma 3.3. To prove b), from (4.4) and 
(4.3) we have 


> 


[ e (u) du [ h?(u) du = @° | EB log f(x; | du 


=¢ [ BE log fe; 0) | seo) dx = 1 


when we use (4.1). 
Thus we have shown that, when an efficient estimator 6,, exists, the limiting 


distribution of C%, is the same as the limiting distribution of [y *,(u) du, where 
“0 


Y,(u) has mean 0 and covariance p(s, ¢) given by (4.5), and approaches a Gaus- 
sian process Y(u) in distribution. We need to show that this limiting distribution 


1 
in tha eames os the Gictiiiation of C o | Y*(u) du where Y(u) is a Gaussian 
0 
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process with mean 0 and covariance p(s, t). To state the theorem formally, 
THEOREM 4.1. In the case of an efficient estimator, 


1 
lim Pr {C4 < z} = Prd | Y*(u) du < “\, 
ao “0 


where Y(u) is a Gaussian process with mean 0 and covariance p(u, v) given by 
(4.5). 


Actually we are going to suppose that ¢(u) satisfies the 
AUXILIARY ASSUMPTION. ¢”(u) exists almost everywhere for 0 S u S 1 and 


(4.6) |e” (u) | w(1 — u) log log aw du < o, 


We first show the Y,(u) process can be expressed in terms of Z,(u) and that we 
have the representation 


From (3.6) and (4.2) we have merely to show 
* in a wd “— 9 
| e” (t)Z,(t) dt = — Va 3 8 f(X; 58). 


By using (3.4) for Z,(t), integrating by parts, and using (4.3) to obtain ¢g’(t) = 
o(0/00) log f(x; 6), where t = F(z; 0), the result follows. 
Now the process Z(u), which is the limit in distribution of Z,(u) given by 
(3.4), is Gaussian with mean 0 and, by (3.8), covariance k(s, t) = min (s, t) — st. 
1 


It has been shown [6] that the random variable | gy” (u)Z(u) du exists (and is 
1) 


Gaussian with mean 0) when the auxiliary assumption (4.6) is satisfied. Then 
the process 


(48) ¥(u) = Z(u) + ¢(u) | e” (t)Z(t) dt 


is Gaussian with mean 0 and covariance 
el 1 
E(Y(u)¥(v)) = k(u, v) + glu) I y’ (t)k(v, t) dt + ¢(v) | ¢ (t)k(t, u) dt 
2 1 
+ ¢(u)y(r) | | ¢ (t)e"(s)k(t, 8) dt ds. 
1 


Since | ¢”(t)k(v, t) dt = —¢(v), the covariance becomes 
“0 


E(Y¥(u)¥(v)) = k(u, v) — 2p(udev) + e(u)e(v) I e” (t)o(t) dt 


Ku, ») — 2p(u)olo) + o(udelo) | ot) at 


k(u, v) — g(u)e(v) = plu, »), 
where we have used b) of Lemma 4.1. 
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Hence (4.8) is a representation of the process Y(u) of Theorem 4.1 in terms 
of the process Z(u). Then since | : Y’,(u) duis a functional of Z,(u) continuous 
in the uniform topology by (4.7), it follows from a theorem of Donsker [9] that 
its limiting distribution is the same as the distribution of I Y’(u) du for the 


process (4.8) or the process Y(u) of the theorem, and the proof is complete. 
By virtue of Theorem 4.1 we can now concentrate on the process Y(u) and 


1 
attempt to find the distribution of C? = | Y%(u) du. 
Jo 


5. Case of a maximum likelihood estimator. When an efficient estimator for 
6, for finite n, does not exist, it will generally happen that a maximum likeli- 
hood estimator for @ will exist and be asymptotically efficient in the sense of 
Cramér. In this case, the results of Section 4 will still be valid. 

We shall assume that the conditions of Cramér ({1] pp. 500-501) are satisfied. 
These conditions imply that conditions 1)-6) of Lemmas 3.1 and 3.2 are satis- 
fied with the exception of condition 4). We shall suppose this condition to be 
satisfied also, calling it a condition of “weak-biasedness’’ on 6, . In some cases, 
as with the efficient estimators, 6, is actually unbiased and 4) is trivially satisfied. 

The following analysis parallels exactly the development in the preceding 
section. The formulas are all the same except for additional terms which ap- 
proach 0 in the mean and with probability one. We merely indicate the develop- 
ment leading to theorem 5.1. 

Defining o” as in (4.1), we can write 


a “~ 9 Pe ae 
5g 08 L = Di 5 log $(Xj58) = (be — CL + a), 


where ¢, — 0 in the mean and with probability one. Then (4.2) becomes, with 
€, — 0 strongly, 


* (dn — 0) = DS tog (x, 501 + €) 


Consequently, h,(u) — h’(u) and o% = Var(+/n(6, — 0)) > o forn > @, 
where h’,(u) is given by 2) of Lemma 3.3 and h’(u) by (4.3). Accordingly, p,(u, v) 
given by (3.11) converges to p(u,v) defined by (4.5). Thus we can generalize 
Theorem 4.1 to 

THEoreM 5.1. If 6, is a weakly-biased maximum likelihood estimator satisfying 
Cramér’s conditions, and if o(u) satisfies (4.6), then 


1 
lim Pr {C2, < z} = Pr{ | Y*(u) du < x 
0 


where Y(u) is a Gaussian process with mean 0 and covariance p(s, t) given by 
(4.5). 


1 
The theorem says that C%, converges in distribution to C? = | Y*(u) du. 
0 
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6. The limiting distribution of C%, . In the preceding sections we have reduced 
the problem of finding the limiting distribution of C%, under general conditions 


to that of finding the distribution of [ Y*(u) du, where Y(u) isa Gaussian proc- 


ess with mean 0 and covariance p(s, ¢) given by 


(6.1) p(u, v) = k(u,v) — g(u)e(v), k(u, v) = min(u, v) — w; 


y(u) = o 5 F(a; 6), u = F(x; 6); 


= if (2 log f(z; ») f(x; 6) ax] 


The function g(u) can also be determined from 


(6.2) 


g'(%) = o = log flz;6), w= F(z;6). 


1 
In determining the distribution of | ¥*(u) du we chall uses basic theorem 
0 


due essentially to Kac-Siegert [10]. It states that the distribution of this random 
- variable is the same as the distribution of a sum of weighted x’, 


1 oo 2 
C= | Y*(u) du = >> Ga 
0 n=1 An 


where G,; , G2, --- are independent normally distributed random variables with 
mean 0 and variance 1, and \;, Az, --- are the eigenvalues of the kernel p(s, ¢). 
Proof of this result for nonstationary processes follows almost immediately from 
[10]; it may be found, for example, in Fortet’s paper [11]. We have for the ch.fn. 


B exp E [ Y*(u) au} = I (1 ote =) 


This expression is merely (D(2it))~"”, where D(A) is the Fredholm determinant 
associated with the kernel p(u, v) in (6.1). To state matters formally, we have 
THEOREM 6.1. Under the conditions of Theorem 5.1, 


lim E{exp (itC%,} = [D(2it)]*”, 
where D(d) is the Fredholm determinant of the integral equation 


1 
f(z) =» I (x, v)f(y) dy 


in which p(x, y) is given by (6.1). 

Thus, for g(u) given, it is necessary only to determine D(\) and invert the 
ch.fn. (D(2it))~” in order to obtain the limiting distribution of C%, . It turns out 
to be possible to get a fairly explicit formula for D(A), but the resulting ch.fn.’s 
seem very difficult to invert. 

We first prove a result more general than needed but which may be of inde- 
pendent interest. 
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THEOREM 6.2. Let k,(z, ) be a symmetric, bounded positive definite kernel over 
the unit square 0 S x, y S 1 whose Fredholm determinant d,(\) has simple zeroes 
0 < Ai < Ae <-->, and let the corresponding eigenfunctions be fi(x), fo(x), - 

Let 


a; = c(f;) = I fAaer(2) dz, gi(z) € L,(0, 2). 


1 
Put c(g) = I g(x)gr(x) dx. Then the Fredholm determinant D,(d) for the kernel 
0 


pi(z, y) = k(x, y) — oi(z)er(y) 
is given by 
D,(A) = di(d) (1 +A > x): 


Proor. The integral equation 


(6.3) g(x) =X | [ki(x, y) — gi(x)eily)] gly) dy 


can be written 


(6.4) g(a) = —dex(z)elg) + 2 | k(x, v) of) a. 


We have the familiar series ({12] p. 228) 


(6.5) g(x) = —de(g) 2 — > fila), dj. 


pre Aj 
This is not a solution to (6.3), since g appears on both sides. But we may mul- 
tiply both sides by ¢:(x) and integrate; termwise integration of the series is easily 
justified. We obtain 


e(g) = —e(g)ADaj/(1 — d/dj). 
Hence either g is such that c(g) vanishes, or else \ must be a root of the function 
P(\) = 1+ A30a5/(1 — A/A)j). 


If \ ¥ A; ,, then c(g) cannot be zero, since otherwise (6.4) would be a homogeneous 
equation with a nontrivial solution existing for \ not an eigenvalue of the kernel. 
Consequently, the only possible values of \ for which (6.3) has a solution are 
either the roots of P(A) or else X = A;. That is, \ must be a root of D(A) = 
di(A)P(A). 

Now P(A) is analytic save for possible simple poles at \ = A;. Hence D,(d) 
is an entire function of \ with D,(0) = 1, and is of genus zero. We note that 


1 yl 
Liars = | klss)ds<, La=| ga < ». 
-0 +0 
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Consequently, if for any root A = A* of D,(A), (6.3) has a solution g*(x) with 
| g*’(x) dx = 1, then D,(A) is indeed the Fredholm determinant of the kernel 


pil, y) = k(x, y) — ¢i(z)gr(y) in (6.3). 
Let now A = \* be a root of Di(A) = di(A)P(A). We have the following two 
cases 


(1) A* #X;; (2) rA* = };, a; = 0. 


In case (2), if \* = A; and a; ¥ 0, then D,(A*) ¥ 0, since the roots of d(A) are 
simple. 

In case (1), A* is a root of P(A); we show immediately that * is real and sim- 
ple. If we substitute the function 


ee afhe)_/ Elite Aaa 
(6.6) g*(x) ) peg te T— AA; [Vx (1 — A*/d;)? 


in (6.3), we verify easily that it satisfies the equation. Since the kernel in (6.3) 
is symmetric, A* is real. Then, since 


2 
Po) = X(-%,), \ ~ i; if a; ¥ 0, 
3 


1 
is positive for real \, * is simple; the case when / ¢i(x) dz = 0 is disposed of 
“0 


easily, of course. Thus, for any root under case (1) we have the solution g*(z) 
given by (6.6). 

In case (2) there are two subcases, P(A*) # 0 and P(A*) = 0. If P(A*) ¥ 0, 
then A* = },; is a simple zero of D,(A); in this case f;(xz) is readily seen to satisfy 
(6.3), and f;(x) is orthogonal to ¢;(z). If P(A*) = 0, then D,(A) has a double root 
at \ = X*, and besides the solution f;(z) we have the solution g*(x) of (6.6), 
which is orthogonal to f;(x). Accordingly, to each root of D,(A) we obtain solu- 
tions to (6.3) of the proper multiplicity. Theorem 6.2 is thus proved. 

There is only a slight complication to prove an analogous theorem in the case 
when d;(A) has repeated roots. 

By plotting the function P(A) for real A, it is easy to prove that D,(A) has at 
most one negative zero \¢ ; the condition for its existence is that }°7_1 3 > 1, 
or that the series diverges. If the positive zerosare0 < MSM S---, repeated 
according to their multiplicity, we verify easily that \7 = ,; for j = 1, 2, --- 
This remark will be useful in the sequel. 

In Theorem 6.2, in order to find Di(A) = d,(A)P(A), it is necessary to know the 
\; and the Fourier coefficients a; of ¢:(x). The following theorem gives an evalua- 
tion of D,(A) through the solution of a nonhomogeneous integral equation with- 
out specifically bringing these quantities into evidence. 

THEOREM 6.3 Let ki(x, y) and ¢,(x) be asin Theorem 5.2. Regarding s asa param- 
eter only, let u(t, s) be the solution of 


(6.7) w(t, 8) = er(ter(s) +2 | ale, Ouls, 8) dé. 
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Then the Fredholm determinant D,(d) for the kernel ki(x, y) — ¢i(x)eu(y) ts 
DO) = a) (1 +» [ we,o at). 


The theorem follows quite simply from the series solution ([{12], p. 228), using 
the previous notation, 


ut, ) = Ye AY ous) 


1 
so that | u(t, t)dt = >-a;/(1 — d/d,;). The result follows by using Theorem 
0 


6.2. 
For the analysis of the present problem, we have, from (6.1), k(z, y) = min 
(x, y) — xy. In this case it is well known that 


=r, fixe) = V2sinxjz, d(d) = (sin Vd)/V. 


Using Theorem 6.2 we have, concerning the limiting ch.fn of C%, , 
Corouuary 6.4 The function D(d) of Theorem 6.1 is 


sin VX a; 
onan Vx M(+a vice ss) 


1 
where a; = ~/2 | g(x) sin xjx dz. 
/o 


It turns out to be possible to replace this expression by a quadrature, and we 
have 
TuHeoreM 6.5 The function D(dr) of Theorem 6.1 is 


(6.8) D(A) = any 92 [ [ ¢'(s)e’(t) cos ~/X(1 — t) cos VX 8 ds dt. 


To prove the theorem we first note that 
1 
arka, = v2 | yg’ (t) cos krt dt. 
0 
Hence, supposing initially that \ ~ res 


a ae rw = 


ie cos kt cos ae 


1+ | I aie _ eva Lit, a dt ds 
sin a A 7 ¢' (t)e’(s) L(t, 8) dt ds, 
cos VX(1 — t) cos~/X8, t= 


=l|]— 


Lit, s) = 
icos WA(1 — s) cos YXt, t 
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Hence, since D(A) = (1/+/X) sin ~/X P(A), we obtain the conclusion to the 
theorem, L(t, s) being symmetric. 

By using Theorem 6.3 we can obtain an alternative expression for D(A) in 
terms of the solution to a differential equation. 

THEOREM 6.6 Regarding \ and h as parameters, let v = v(t, h) be the solution to 


(6.9) v” + dv = he’ (bt), v(0,h) = v(1,h) = 0. 
Then the function D(d) of Theorem 6.1 is 
(6.10) DQ) = (1/-VH) sin -VX(1-+ [of 0) at). 


In fact, the integral equation (6.7) is equivalent to the differential equation, 
with s parametric, 


vo” + dv = ¢o(s)e” (2), 


which vanishes at t = 0 and ¢ = 1. Hence, using Theorem 6.3 we obtain (6.10) 
immediately. 

The result of Theorem 6.5 follows directly from Theorem 6.6, for in solving 
(6.9) we determine the Green’s function G(é, ¢) for the differential expression 
v” + dv over the interval (0, 1). This is 


sin -Vié sin ~/A(1 — 2) 


le ak ie Pn 5 t> é; 
; sin ~/xt sin ~/A(1 — £) 
/x sin ~/X , ‘2 


1 

Hens eo = hb I G(é, t)e” (t) df, so that (6.10) will give (6.8) after integration by 
0 

parts. 


The above results give various methods of obtaining D(A) and the ch.fn. of 
C’, which is [D(2it)|”. The distribution can be obtained by the inversion for- 
mula 


uz) = 2 [Deane ay, 


i< eg Wa 
UG) -1-2P(-y f Sa 
where’ U(x) = [ u(y) dy is the cdf of C’, and 0 < Ay < A» < --- are the (sim- 
ple) zeros of D(A). 
7. Properties of the C%, test. A matter of central interest is whether the C%, 


test has certain distribution-free properties. For example, it is important to 
know if it is parameter-free, that is, if the limiting distribution of C’, does not 


2 The factor (—1)*"! is missing throughout Smirnov’s [14] analysis. 
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depend on the parameter @ in F(z; @). Clearly the test will be parameter-free if 
and only if g(u) given by (6.2) does not depend on 6; only in this case do we 
really have a usable test. This turns out to be the case when @ is a location or 
scale parameter. 

TueoreM 7.1 If R(x) is a cdf and if F(x; 0) = R(x — @) or F(x; 6) = R(x/68), 
for @ > 0, then ¢(u) is independent of @ and the C%, test is parameter-free. 

To prove the theorem, we need only compute ¢(u) as given by (6.2). Let r(x) 
be the density corresponding to R(x). Then, when F(z; 6) = R(x — 6), easy 
calculation shows 


(7.1) elu) = —([" *ey/ra)l dz) rR). 


When F(x; 6) = R(x/6), 


oo —1/2 
72) elu) = -( f 24%Ga)/nta)) de — 1) Rw Rw)), 


where R™'(u) is the inverse of R(x). 


Another case of interest is F(z; 0) = [R(zx)]’ for @ > 0. Here easy computa- 
tion shows 


7.3) g(u) = u log u. 
Likewise when F(z; @) = 1 — [1 — R(z))’ for 6 > 0, we get 
¢g(u) = —(1 — wu) log (1 — wu). 


In these latter two cases, ¢(u) does not even depend on R, so the test is distribu- 
tion-free over this class of cdf’s. 


In general, however, ¢(u) does depend on @. Consider, for example, 


F(a; 0) = OR*(x) + (1 — 8)R(z), 05081. 


For this, simple calculation gives 


1‘) ( -1+0+¢V(i- + of) 
- u—- — —— 


Although not depending on R, this does depend on 6. At @ = 0 we get g(u) = 
/3 u(l — u). 

In Section 6 we have given various methods of obtaining the Fredholm de- 
terminant D(A) for the kernel p(u, v) = min (i. v) — w — ¢(u)g(v). The eigen- 
values, \, fork = 1, 2, --- , of this determinant are positive since p is a corre- 
lation function; that is, the case of one negative root \») of D(A) discussed at the 
end of the proof of Theorem 6.2 does not occur. For the limiting semi-invariants 
of C%, we then have [6] 


(7.4) K; = 2"*G -— 1)! Yi, j =1,2,-:: 
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1 
or K; = 27"(j — 1)! | p;(u, u) du, where p;(u, v) is the jth iterate of the kernel 
0 


p(u, v). Thus the mean K;, and variance K; of C’ are, for example, 


(75) p=Ki= I p(u, u) du = | [s(1 — s) — ¢(s)] ds = % — i ¢’(u) du, 


d@ = K,=2 [| tin (u, v) — w — ¢g(u)e(v)]’ du dv 
(7.6) _ 


=Ms—8| 01-0 | ole) dedt + 2u — 16) 


These expressions may be compared with the corresponding expressions for 
the case when there is no parameter to be estimated, that is, the W%, test of the 
hypothesis (1.2). From the remark at the end of Theorem 6.2 we conclude that 
\. 2 wk’, so that from (7.4) it follows that all the semi-invariants (in particular 


the mean and variance) for C* are less than the corresponding semi-invariants for 
w 


Expressing now W’ and C’ as a weighted sum of x’ variables, we have 
W* = VGi/r7, C= LG/;, 


where G, , G:, --- are independent Gaussian random variables with mean 0 and 
variance 1. All the weights 1/\,; in C’ are less than the corresponding weights 
1/27’ in W’; this is the analogue to the reduction of the number of “degrees of 
freedom” in the usual x’ test. It is accounted for by the fact that there is addi- 


tional freedom in fitting the empirical and theoretical cdf’s because of the esti- 
mated parameter 6. 


In particular, by (7.5) the mean of C’ is less than the mean for W*, which is 
1 
lé, by the factor | ¢’(u) du. This dimensionless quantity gives an idea of the 


“diameter” of the family F(z; 6) with respect to @. 


8. Illustrative examples. 
A. Location parameter. Let F(x; 6) be of the form 


F(x; 0) = R(x — 8), f(z; 0) = r(x — 8), 


for a cdf R(x) whose density is r(z) = R’(x). Then denoting 


c= ( [7 wera) ae) 


we have by (7.1), g(u) = —or(R™(u)). Since 


¢e(R(y)) = —or(y), ¢(R(y)) = —or'(y)/rly), 
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we get by (7.5), (7.6), and (6.8) 


p=K-o [ r(x) da, 


d= Ys — 80' [1 — RF) dy [ Re)P@) de + Au - 36) 
D(a) = (sin VX)/VA 
— 20° e cos [+/X(1 — R(y))]r’(y) dy . cos [\/X R(z)]r’(z) de. 


Unfortunately, even in simple cases it does not generally appear possible to 
evaluate D(d) further, let alone invert the ch.fn. [D(2it)|"’” of C*. This seems to 
be true for the normal distribution, that is, r(x) = (1/+/2x) exp (—}z’). 

As a special case, let F(x; 6) be the Cauchy distribution F(z; 6) = R(x — @). 
Then 

R(x) = $ + (1/x) tan” 2 = 4; 
1 1 
wee 
o = 2, g(u) = (—+/2/n) sin’ ru. 
Consequently » = % —1/4n’, and 


x = —cot ru = R™(u) 


Do) = S23 4 (,) (1 — os +). 


Va. \4e—X 


Another case in which D(A) can be evaluated explicitly is R(x) = 4 + 4 tanh 
x, in which case g(u) = +/3 u(l — u). 
B. Scale parameter. Let F(x; 6) = R(x/) for 6 > 0, and r(x) = R’(x). Put 
~ —1/2 
o= ( [ a'[r”(x)/r(x)] az) 


so that, by (7.2), e(u) = —oR™(u) r(R~(u)). Since 
e(R(y)) = — oyr(y), =o (R(y)) = —oly r’(y)/ry) + D, 
we obtain by (7.5), (7.6), and (6.8) 


p=-o [ y’ r'(y) dy, 
d = Ys — 80° r [1 — Rly) y ry) f R(x) x P(x) dx dy + 2(u — 1%)’, 
D(a) = (sin VD)/-VX — 20% [cos VX 1 — Ry) ly ) + vO) 


[ cos WxR(x)[xr'(x) + r(x)] dx dy. 
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Consider again the case of the Cauchy distribution, where 


Riz) = 3+ i tent2 =u, 42) : 


T ™ wl + 7’ 
The above formulas give 


o= V2,  o(u) = (1/0 2x) sin 2ru, 


z= — cot ru. 


1 sin Vd 1 
re ae 
In this case D(A) has zeros at \ = 2°3’, except for 7 = 2. In the representation 
C* = >°*Gi/x';’, where G:, G:, --- are independent Gaussian random vari- 


ables with mean 0 and variance 1, the star on the summation means to exclude 
the term j = 2. Thus C’ and W’ differ only in that W’ has this term included. 
This is a genuine case of a loss of a “degree of freedom”, that is, one less term in 
the sum of the squares. 

C. Exponential parameter. Suppose, as before, that F(x; 6) = [R(z)]’ for @ > 0. 
Then, as in (7.3), g(u) = uwlogu and 


u= Ye — 27 = 092598, 9d” = M45 — 88{105 + 18404 + 8429 = .0043566, 
1 
D(a) = (sin -Vx)/Vx — 2 l (1 + log t) cos Vx (1 — 2) 


t 
-| (1 + log s) cos ~y s ds dt. 


9. Further considerations. 

A. Incorporation of a weight function. If, instead of the C%, statistic defined by 
(1.4), we use a weight function y(x) = 0 as in [6], and define a new test statistic 
C%” by 

C= nf Ural) — Flo; b)F VPC; by) dP; bn), 


we can carry through a theory paralleling that in the preceding pages. Here 
y(z) must have a bounded first derivative in 0 S x S 1, and we should be led 


to the evaluation of the distribution of C*” = / Y*(u)¥(u) du, where Y(u) is 


the process defined in Theorem 4.1. In this case we will need to use the results 
for D(A) given in Theorems 6.2 and 6.3, using 


p(s, t) = k(s, )VYsv), els) = o(s)VV), 


where k(s, ¢) is given by (3.8) and ¢(s) is as in (4.4). A method for evaluating the 
function d,(A) in Theorems 6.2 and 6.3 is given in [6] for p:(s, ¢) of this form. 
Then the ch.fn. for C* is [D,(2it)]*”. 
B. A Kolmogoroff statistic. In place of C%, we can consider 
K, = sup Vn |F.(x) — F(z; 6,)), 
<r 
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following the test proposed by Kolmogoroff (cf. [6]). The limiting distribution of 
K,, is the same as the distribution of 


K = sup |Y(#)I, 
0<t<1 


where Y(t) is the process of Theorem 4.1; that is, Y(u) is Gaussian with mean 0 
and covariance p(s, t) = min (s, t) — st — ¢(s)g(t). Unfortunately Y(u) is not 
Markoffian and the usual methods of determining the distribution of K by dif- 
fusion theory will not work. However, in the representation of Y(u) by (4.8), 
the processes Y(u) and Z(u) are jointly Markoffian and a two dimensional dif- 
fusion equation could be used. 

Grenander and Rosenblatt [13} were led to an absorption probability for a 
Gaussian process with covariance min (u, v) + g(u)g(v) in the estimation of the 
spectrum of a stationary process. In their case the covariance is the sum of two 
positive definite kernels, rather than difference, as in p(s, t), which simplifies 
matters considerably in calculating distributions. 
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CHARACTERIZATIONS OF COMPLETE CLASSES OF TESTS OF SOME 
MULTIPARAMETRIC HYPOTHESES, WITH APPLICATIONS TO 
LIKELIHOOD RATIO TESTS! 


By ALLAN BIRNBAUM 
Columbia University 


1. Summary. For the problem of testing a simple hypothesis on a density 
function of the form fe(e) = exp {Wo(@) + > ¥:(0)t(e) + t(e)}, explicit char- 
acterizations are given of a minimal essentially complete class of tests, the mini- 
mal complete class, and the closure of the class of Bayes’ solutions, under certain 
assumptions. Applications are made to discrete distributions of the above form 
and to some problems of testing composite hypotheses. The likelihood ratio tests 
of these hypotheses are characterized and shown to be admissible under certain 
assumptions. 


2. Introduction. Consider a probability density function of the form 


gy(e) = exp {vs + x vite) + wie 


with e asample point in an n-dimensional Euclidean space, andy = (yi, --- , ¥e) 
a parameter in a subset Y of a k-dimensional Euclidean space. It can be shown 
[1] thatt = (4, --- , &) = [h(e), --- , &(e)] is a sufficient statistic which admits 
a density 


p(t) = exp {ve + » Viti t oh 


with respect to a measure in a k-dimensional Euclidean space, and that the 
family of such densities with y ¢ ¥ is strongly complete. A family M of measures 


pe on T is called strongly complete (1) if / f(t)due = 0 a.e. in Lebesgue measure on 
T 


WV implies f(t) = 0 a.e. M. 

We shall assume that p,(¢) is a density with respect to Lebesgue measure unless 
the contrary is specified. Let 7 denote the set of values of ¢ for which p,(t) > 0 
for some fixed y ¢ ¥; we assume here that 7' does not vary with y. 

We shall consider the problem of testing a hypothesis Hy): y ¢ w against an 
alternative H, : y ew’, where w and w’ are disjoint subsets of ¥. For the one- 
parameter case (k = }), complete class results have been obtained by Lehmann 
[2] and by Blackwell, Girshick, and Rubin (cf. [3]), and certain minimax results 
have been obtained by Allen [4]. The present paper contains generalizations of 
Lehmann’s results. We shall be concerned in the following with the case in which 
w consists of a point ¥° and w’ = YW — w’, except where otherwise specified. 
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ophy in the Faculty of Political Science, Columbia University and sponsored by the Office of 
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For all statistical purposes we can, as shown in [5], restrict our consideration 
to tests of Hy each characterized by a measurable decision function 6 = 4(¢), 
where 0 < 4(¢) S 1, defined on 7’, such that when ¢ is observed the test rejects 
Hy with probability 6(¢). 

For any test 5, let 8:(y) denote the probability that the test will accept Ho 


when y is the parameter point; that is B:(y) = 1 — [ pya(t) dt. We define the 
T 


risk function r3(y) of a test 6 as follows: 


Bal) v é w’, 
ny) =(1—Bly) peo, 
0 ye(WY —w —w’). 


Let &(¥) denote a cumulative distribution function defined on ¥. A Bayes’ 
solution with respect to &(y) is a test 5: such that the “Bayes’ risk” r;(~) = 


[ rs(¥) d&(W) is minimized by taking 6 = 6; . Let B denote the set of all Bayes’ 


solutions; that is 6 « B if and only if there exists a — such that 6 is a Bayes’ 
solution with respect to ¢. Let V’ denote the set of all tests 6 such that 6 is non- 
randomized (i.e., 5(#) is 0 or 1 only) and the set A on which 4(t) = 0 (the test’s 
acceptance region) is the common part of 7 and some open convex set in k- 
dimensional Euclidean space. Let V denote the set of all tests 6 such that 6 « V 
if and only if there exists a 5’ e V’ such that the set on which 8’(t) ~ 4(¢) has 
Lebesgue measure zero. 

The following are the usual definitions of some terms which will be used below: 
A class of tests is called complete if for every test 5 outside the class there is a test 
5’ in the class which is uniformly better, that is such that rs(W) S rs(W) for all 
y and ry (Ww) < rs(W) for some y. A class of tests is called minimal complete if it 
is complete but has no proper subset which is complete. A class of tests is called 
essentially complete if for every test 5 outside the class there is a test 4’ in the class 
such that rs(W) S rs(W) for all y. A test is called admissible if there exists no 
uniformly better test. A class of tests is called minimal essentially complete if it 
is essentially complete but has no proper subclass with this property. A test 6 
will be called uniformly as good as a test & if rs(¥) S rs-(W) for ali y. 


3. Characterizations of complete and essentially complete classes. The follow- 
ing theorem has been proved by Reiersgl [7]. 

THEOREM 1. B is a subset of V. 

Proor. For any §, let y be the saltus of £ at y = y°. Then 


nde) = | ray) axty) = [ aulv) ae(y) + 101 — 2800) 


[ | [ a - erro at| del) + — 2 [11 — OIpuld a 


7+ [ ( [ py(t) ax(v)) - rut) | {1 — a(t)} dt. 


ee 
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Let Q() = | u(t) dk) — 2rpye(t), 80 that 


rfe) = | QC - a) att 
Clearly r;(€) is minimized by 6 = 4 such that 
O teA; = {t|Q@ <9}, 
&(f) = 
1 all other ¢. 
But Q(t) < 0 is equivalent to 


ay > | (By) ae 





= [ exp {x (Yi — Viti + (Yo — vo} de(y) 
= R(t), say. 


Thus A; = {t| R(t) < 2y, teT}. 
Now for 0 < \ < 1 and for any real u and v, we have 


gata-we < de" fe (1 we re”, 


with strict inequality holding in case u ~ v. Thus if ¢’ and ?” are distinct points 
in A; , then for 0 < A < 1 we have 


Rat’ + [1 — Alt”) < AR’) + (1 — ARM”) < 2, 


proving that 6; eV’. Furthermore R(t) = 2y holds only on a set of Lebesgue 
measure zero. For 


: = - [ (ys — vi) ep {X (Wi — Viti + Yo — v3) de(y) 





is nonnegative for all t, for each j. Moreover, if for any j and t, a°R(t)/ at; = 0, 
then Pr{y; — ¥$ | £} = 1. If for some t we have @°R(t)/at; = Oforj = 1, --- k, 
then Pr{y = y°|£} = 1. 

In the latter ease the Bayes’ acceptance regions are 7’ itself and all subsets 
which differ from T by sets of Lebesgue measure zero. In the remaining case we 
have that for each ¢ ¢ T there exists a j for which d°R(t)/at} > 0. Hence R(t) = 
2y holds at most on the boundary points of the convex acceptance region A;, 
which constitute a set of measure zero. 

Since R(t) = 2y holds only on a set of Lebesgue measure zero, every Bayes’ 
solution with respect to £ must differ from 4; at most on a set of Lebesgue measure 
zero. Hence every Bayes’ solution is in V. Q.E.D. 

Wald ({6], Theorem 5.8) has proved that under assumptions which are satis- 
fied by p,(t), an essentially complete class of tests is constituted by the closure 
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B of B in the sense of regular convergence, which is defined as follows: lim;.. 6; = 
5 in the regular sense if 


lim | 5,(t) dt = / 5o(t) dt 
imo “YR R 
for any bounded subset R of the sample space 7’. If lim;.. 6; = 4) except on a 
set of Lebesgue measure zero, then it is clear that 5; converges to do also in the 
regular sense. For the special case of 5; ¢ V (but not in general) the following 
converse is also true. 

Lemma. Let lim;.. 6; = 59 in the regular sense, where 5;(t) = 0 on a convex set 
A;, and 5,(t) = 1 elsewhere. Then lim;.. 5; = 59 except on a set of Lebesgue 
measure zero. Furthermore 5) ¢ V, and except on a set of Lebesgue measure zero, 


0 ona =limf 4;, 
do(t) = =e 
1 elsewhere. 
Proor. Let 
Ap=lim U A;, a=limNA;, D=Ao— a. 
tee f2e to j2i 

It is clear that ap is convex. If lim;.. 6,(¢) does not exist almost everywhere 
in Lebesgue measure, then »(D) > 0, where » denotes Lebesgue measure. 
For infinitely many A; we have D C A,, and for infinitely many A; we have 
DA; = 0. 

Let h be a point of D which is not a boundary point of a) . Let H be the smallest 
convex set containing a andh, and let k be aninterior point of H — a . Such points 
h and k exist except in the trivial cases u(D) = 0 or u(ao) = 0. 

Let K be the convex cone consisting of the half-lines from k through the points 
of a . Let K* be the ‘“‘negative’’ cone consisting of the other halves of the same 
lines. Then u(HK*) > 0. Since h ¢ D, we have HK* C A; for infinitely many 
A,, and HK*A; = 0 for infinitely many A; . Let R be a bounded subset of HK* 


with u(R) > 0. Then [ 5,(t) dt = w(R) > O for infinitely many 7, and also 
R 


[ 6,(t) dt = 0 for infinitely many 7. Thus 6; do not converge in the regular sense 
R 


if u(D) > 0, proving the first assertion of the lemma. 

If the 6; converge in the regular sense, and hence u(D) = 0, the second as- 
sertion of the lemma follows from the fact that a is convex. 

From the lemma it follows that V = V, where V denotes the closure of V 
in the regular sense. Since B C V by Theorem 1, B Cc V = V. Since B is es- 
sentially complete we have 

Coro.uary 1. V is an essentially complete class. 

Since for every test in V there is a test in V’ with identical risk function, we 
have 

Coro.uary 2. V’ is an essentially complete class. 
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The above-mentioned completeness property of the family of distributions 
py(t) implies that two decision functions with identical risk functions differ at 
most on a subset of 7’ with Lebesgue measure 0. Hence we have 

Coro.uary 3. V is a complete class. 

In the following sections it will be shown that, under certain additional assump- 
tions, affirmative answers to the following questions hold. 

1) Does B coincide with V? 

2) Is V the minimal complete class? 

3) Is V’ a minimal essentially complete class? 

In general V will not be minimal complete if w’ is a proper subset of VW — w. 
For example, consider the case in which p,(t) = (27) ” exp {—3(4 — W)"}, 
with w’ and w’ consisting respectively of ¥: = 0 and y; = 1, and with k = 1. 
Here the minimal complete class is known to consist of the class of best tests of 
all sizes. The acceptance regions of these tests are all the intervals which are 
infinite to the left and all the sets which coincide with such intervals to within 
sets of Lebesgue measure zero. Since these acceptance regions are a proper sub- 
class of V, V is not minimal complete. 

However, V is known to be minimal complete in some one-parameter cases. 
If we take the preceding example with w’ altered to consist of y; = 1 and yi = 
—1, the minimal complete class consists of all “two-tail” tests of all sizes ([6}, 
pp. 136-138). The acceptance regions of these tests are all the intervals and all 
the sets differing from intervals by sets of Lebesgue measure zero, that is just 
the class V. Here V’, the class of all open intervals, is clearly minimal essentially 
complete. 

For other density functions p,(t) with k = 1 (that is, one-parameter distribu- 
tions) the same properties can be proved for V and V’ provided w’ contains a 
point ¥; < ¥} and a point Wi > ¥1 (cf. [2]). While the following two sections 
give the same conclusions for k > 1, they necessarily require stronger restric- 
tions on w’. Thus the one-parameter results referred to will not all be contained as 
special cases. 


4. Full characterization of B. Hereafter “a test A” will mean a (nonran- 
domized) test 6 with 6 = 0 on A and é = 1 on T—A. 

AssuMPTION 1. The subset w’ contains hyperspheres of arbitrarily large radii. 
That is, for some increasing unbounded sequence d;, dz, --- , all formal solu- 
tions y of the equations dj = > (vy; — v$)* for j = 1, 2, --- are contained in 
w’. This assumption is satisfied if V is k-dimensional Euclidean space and ¥ — wo’ 
is bounded. 

THEoREM 2. If Assumption 1 is satisfied, V = B. 

Proor. Since V = V, and by Theorem 1, B C V, we have BC V. It re- 
mains to show that V C B. The method of proof will be to show that every 
A ¢ V isan essentially unique limit (in the regular sense) of a sequence of Bayes’ 
solutions { A;,}. 

Lemma. For every bounded convex set C, the test A = CT is an essentially unique 
limit, in the regular sense, of a sequence of Bayes’ solutions. 
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Proor oF Lemma: Let A be the set-theoretic product of JT and any bounded 
convex set C in k-dimensional Euclidean space. For each point y ¢ (¥ — w), 
let n(y) be the quantity such that 


~Ty;,-yv iz: 
| ] bt) =0, = + 4/S HW - WF, 
d(y) iat 
is the equation of a supporting hyperplane of C, and such that the left member 
of this equation is negative for ¢ any interior point of C. For any d > 0, let 
wa = fy |d) =d}, — p(¥) = exp {(¥o — wo) + nly) dy)}. 
Let oa = [ dws, where dw, denotes an infinitesimal element of (k — 1)- 
wd 
dimensional Lebesgue measure on wz . Let 
1 1 
ai++/ p(W) dug - 
Ya Od Ywg 


Then we define the cumulative distribution functions & = §4(y) as follows: £4 
has a saltus yz at y = y’, and for any subset v of Y-w’, 


[ dta(y) == |, OY) dese 


Consider the Bayes’ solution with respect to & given by 
Ag => {¢| Ra(t) / 27a; te T} 
where, as in the proof of Theorem 1, 


R(t) = £ exp 1d (vi — Vt + (Yo — v3) dta(y). 


i=l 


Rit) = va + vf exp {z (vi — Viti + nly) awh dig . 


Thus 
' k 0 
de ={t)1>2 f exp (¢: [HS e+ a) ]) dow, te 7} 
| Od 4wa i=1 d 


Now for ¢ any interior point of A and d > 0, the exponent in the integrand in 
the preceding expression is d multiplied by a negative quantity which is nu- 
merically never less than A(t), for y ¢ wa, where A(é) is the Euclidean distance 
from ¢ to the closest boundary point of A. Thus as d increases the integrand ap- 
proaches 0 uniformly over wz, and the inequality is satisfied for all sufficiently 
large values of d. Hence each interior point ¢ of A is an interior point of Az for 
all d exceeding some d, . 

For every exterior point ¢ not a boundary point of A, let w; denote the subset 
of wz such that for each y ¢ w4 , the equation 


(vi -vi\, e 
> ( IW) t: + nfy) =0 
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determines a plane which separates ¢ from A; that is the left member of the pre- 
ceding equation is positive for all y ¢w;. Since n() is continuous, [ , dwg = 
@¢ 


m(w4), say, is positive. We can choose e > 0 such that for each d > 0, the subset 
wa of wy such that 


k 0 
& (4) at 2 6 veut, 


satisfies / . dwg = ¥m(w4). Hence in the inequality which defines A, above, the 


@d 
exponent in the integrand is not less than d-« on a set of Lebesgue measure not 
less than 3m(wz). Hence as d increases, the right member of the inequality ap- 
proaches «, and the exterior point ¢ of A is also an exterior point of Aq for all d 
exceeding some d; . Hence we have that A differs from lim,... Ag at most by a 
subset of the boundary of A, which has Lebesgue measure zero, proving the 
lemma. 

Proor or THEOREM 2. Since every unbounded convex set is an essentially 
unique limit, in the regular sense, of a sequence of bounded convex sets, and 
hence is included in the closure of any class which contains all bounded convex 
sets, Theorem 2 is proved. 

EXAMPLE 1. Let py(t) = (1/2) exp [—3{(4 — vi) + (4 — ¥2)"}]. With ¥ as 
the (yi, ¥2) plane and w = {(¥}, ¥2)}, the subset w’ = WY — w’ contains all 
solutions (y; , ¥2) of d’ = (vi — ¥i)* + (We — ¥%)* for d > 0. Hence the con- 
vex sets in the (t,, é) plane are an essentially complete class for testing Hp : 
(vi, v2) = (Wi, ¥2). A similar conclusion will clearly hold when p,(t) is any 
multivariate normal distribution with known covariance matrix and unknown 
mean y. 


5. Characterization of a minimal essentially complete class. 

Case 1: Bounded acceptance regions. 

ASSUMPTION 2. ty is a continuous function of t. 

Let D, denote the class of tests A of Hy whose acceptance regions are bounded. 
Let V; denote the class of tests in V’ with bounded acceptance regions. 

Tueorem 3. If A’ and A” are distinct tests in V3 , then neither test is uniformly 
as good as the other, if ¥ satisfies Assumptions 1 and 2. 

Corotuary 1. If T is bounded, and if Assumptions 1 and 2 are satisfied, then 
V’ is a minimal essentially complete class. 

Proor or Corotiary 1. When T is bounded, V; coincides with V’ which is, 
by Corollary 2 of Theorem 1, an essentially complete class. But an essentially 
complete class, no member of which is uniformly as good as any other, is minimal 
essentially complete. 

Proor or THEOREM 3. Let A’, A” be distinct tests in V; . Assume that 


ray’) _ rary’). 
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Then each of the sets A’ — A” and A” — A’ has positive Lebesgue measure. 
Let ¢* be any interior point of A’ — A”, and let 7’ be any supporting hyperplane 
of A” which separates ¢* form A”. 

Let the equation of 7’ be written )-i ait; + a = 0, with Doi a; = 1. Let 
A(t) = > a;t; + do ; that is, A(¢) is the directed distance from T” to any point 
t. Let 


A* = 1! pe (t; — tf) s \% |act*)| te a’, 


Then A* has measure L(A*) > 0. For ¢’ any point in A*, and ¢” any point of 
A”, the closure of A”, we have 


|A(t’) — A(t”)| = 4\A(E*)| > O. 
Let ¥ = c(a,, --- ay) for any real c, and let 
g(t’, t”, c) = log [pye(t’)/pye(t”)] — (& — &) = cL a(t; — tf) 

= +c|A(t’) — A(t”)|. 
Now by Assumption 1, w’ contains points ¥ with c—> © and with c— —o. 
Hence we can choose a sequence y', ¥*°*, --- such that lim,.., |c;|| = © and 
all c; are of the same sign as > a(t; — t;), fort’ ¢ A* and t” ¢ A”. By Assump- 
tion 3, \t9 — t| is continuous and hence bounded say by », for ¢’ ¢ A* and 
t” « A”. But 
loglpy ci(t’)/py c(t”)] = sex | A(t’) — A(t”) | + (to — te) 
> $ |e:|-|A(e*)| — v. 


Hence lim;.. [pyci(t’)/pye,(t”)] = © uniformly for ¢’ ¢ A* and t” eA”. That 
is, for any M > 0 there exists a c’ such that pyc’(t’)/pyc’(t”) > M for all t’ « A* 
and t” ¢ A”. Let 


p= inf mel’), p= sup pelt’); 
then p/p 2 M. Now 
ra) & | me) dt = LA, 


ray") = | pect dt < L(A"YA, 
where L(A”) is the measure of A”. Hence 
rally’) . L(A*)-p , L(A*) 
rar(¥’) ~ L(A”)-p ~ L(A”) 
But M may be chosen arbitrarily large, in particular so large that 
M > L(A”)/L(A*). 


In this case we obtain r4-(W) > ra-(W) for Y = some yy. 


-M. 
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Therefore A’ is not uniformly as good as A”. Interchanging A’ and A” in the 
preceding discussion, we conclude also that A” is not uniformly as good as A’. 
It remains to consider tests A’ and A” in V; such that 


ra(y’) ~ Ta (y’). 


Assume r4/(y°) < r4--(y’). Then A’ — A” has positive measure. The proof given 
above for the case r,-(y°) = r4--(y°) then shows that there exists a y ¢ Y such 
that ra (y) > ra-(). Similarly if ry-(y’) > ra--(y’), we can show that there 
exists a y ¢ V such that ra-(y) < ra-(W). Q.E.D. 

The method of proof of Theorem 3 can be applied directly to prove that no 
test not in V is uniformly as good as any test in V; . Hence we have 

Coro.uary 2. If Assumptions 1 and 2 are satisfied and T is bounded, then V is 
the minimal complete class. 

These results are used in connection with Example 1 in section 10, below. 


6. Characterization of a minimal essentially complete class. 

Case 2. The General Case. Assumption 3. Let T’ be the common part of T 
and any half-space, that is, 7’ = {t| >> at; + ao S 0, te T}, for arbitrary 
a,’s subject to >> aj = 1. Let ¢’ be any point in T — T’. Then there exists a 
sequence of points y‘ in w’ such that, uniformly in some neighborhood of ¢’, 


lim [pee / [. py s(t) ar| = 0, 


TueoremM 4. If Assumptions 2 and 3 are satisfied, V’ is a minimal essentially 
complete class. 


Proor. By Corollary 2 of Theorem 1, V’ is essentially complete. It remains 
to show that, of any pair of distinct tests A’ and A” in V’, neither test is uni- 
formly as good as the other. 

Given any such pair of tests, at least one of the sets A’ — A” and A” — A’ 
has positive measure. Assume A’ — A” has positive measure, and let ¢* be any 
interior point of A’ — A”. Let A(t) = * a;t; + ao. Let 


A* = { > (t; — @) s jatt*)\’e, te a’. 


Then for some e, with 0 < « < 1, we have by Assumption 3 that for arbitrarily 
large M, there exists iy such that for all t’ « AT, 


pys(t’) / [ pedi) dt > M, Like 
Let p = infreat DPyéu(t). Let L(A‘) be the measure of At . Then 


pam: | rys dt 
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ra(y'™) 2 fh, Priu(t) dt = L(As)-p, 


ray) S |, Posult dt. 


Hence r4(y") = M-L(AP)-ra--(y™). But M may be chosen arbitrarily large, 
in particular so large that M > 1/L(A?), in which case we obtain 

ra(y™) > rary). 
Thus A’ is not uniformly as good as A”. 

If ra-(y’) = ra--(y’), we have that A” — A’, as well as A’ — A”, has positive 
measure. By interchanging A’ and A” in the preceding discussion we conclude 
also that A” is not uniformly as good as A’. If ra-(y") < r4--(y’), then A’ — A” 
has positive measure and as above we conclude that r4/(y) > r4--(w) for some y. 


Similarly if r4-(y°) > ra’(y’), we conclude as above that ra (Wy) < r4’'(p) for 
some y. Q.E.D. 
The method of proof of Theorem 4 can be applied directly to prove that no 
test not in V is uniformly as good as any test in V’. Hence we have 
Coro.uary. If Assumptions 2 and 3 are satisfied, then V is the minimal complete 
class. 


Exampte. Let py(t) = (1/2) exp {— >-i 4(x; — us)*}, and let Ho specify 
(ui, 2) = (0, 0). For any a; , a2, and a such that aj + a; = 1, let 


T’ = {(a1, 22) | ait: + a2, + a SO}, 
y = y(t) = (i, ye) = (arti + et, , —Gyt + Gyre). 


Then we may write p,(t) = (1/22) exp {-4> 3 (y; — »)°}, with Ho: (1, 2) = 
(0, 0), and T”’ = {(y:, ye) | y:1 S —ao}. Let = (m1, ye) be any point not in 
T’; that is, yi > —ao. Let 


_ —Pult) 
[ | py(t) dt 
a (1/2m) exp {—31[(yi — 1)? + (yr — »)*} 
(1/2) [| [exp {¥us — 0 din [exp (Hus — 0} doe 
Proceeding as in [8], we set 
w=0, w=—m—n, A=Yita, h= (2x)? exp (—}y:). 
Then v = h exp [—3(u + A)’ / [ exp [—4r'] dr. 
Now for 1 > yi, 


uU=—-H—n<UtA<0, w> (ut A)’, 
so that exp [—3(u + A)’] > exp [—4u’]. 
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Similarly for v». = 0 and » > yj, 
v > h-(v1 + a), lim, oY = ©. 


Thus Assumption 3 is satisfied, and by Theorem 4 we conclude that the open con- 
vex sets in the (x; , x.) plane constitute a minimal essentially complete class of 
acceptance regions (tests) of Ho . 


7. Other cases. While Theorem 1 shows that B C V holds without restrictions 
on w’, an example above showed that even with k = 1 we do not have B = V 
unless w’ is sufficiently inclusive. For k > 1, when w’ does not satisfy Assumption 
1 it is possible in some cases to use the methods of the preceding sections to ob- 
tain characterizations of minimal complete classes or at least characterizations 
of smaller complete classes than V. 

Such possibilities will be illustrated in a special case in terms of Example 1 
above. Let w’ now be 


{ (va , Ye) | va = 0, Yo = 0, ity > 0}; 


that is w’ is the closed first quadrant with y° = (0, 0) deleted. Then the method 
of Theorem 1 can be extended to show that every Bayes’ acceptance region A; 
has the property that if (t; 2) « A; and t; S 4, and & S t, then (tj ,f2) € Az, 
with exceptions on sets of measure zero. The method of Theorem 3 can be adapted 
to prove that tests having the preceding property constitute the minimal com- 
plete class. 

For cases in which w’ is bounded, in general no simple characterization of the 
minimal complete classes can be given. By extending the method of Theorem 1 
it can be shown that when w’ is bounded the Bayes’ acceptance regions A; can- 
not approximate arbitrarily closely any bounded convex hyperpolygon. Thus a 
minimal essentially complete class consists of a proper subset of V’ which can 
be described roughly as excluding all hyperpolygons with finite vertices and 
edges, and all acceptance regions which closely approximate such hyperpoly- 
gons; as the bounds on w’ are narrowed, more elements of V’ are excluded. 

For some common distributions of the form p,(t), Assumption 1 fails. Examples 
are p,(t) as determined by either 


1 -1~ ; 
(a) gle) = (any pe oxP ‘it > (2: — wt, 


j=l 


z 1 —1 4 (zi; =) 
on We) = Craw exp 2% (Fi Tay 

For the problem of testing a simple hypothesis in (a), the density of a sample 
from a normal population with unknown mean and variance, Stein (in a private 
communication) has constructed a test which is in V, but which can be strictly 
improved on, showing that for this problem V is not a minimal complete class. 
For this testing problem, Walsh [9] has investigated the operating characteristics 
of three tests of Ho as a basis for selecting tests for quality control and other 
applications. Only one of the three tests considered, that one whose acceptance 
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region is a rectangle in the (>> x: , >> 2,)-plane, is contained in V and hence 
may be admissible; the remaining two tests are inadmissible. 

For the class of problems considered in this paper, no general method is yet 
known for constructing a test which is uniformly better than a given inadmissible 
test. On the other hand, when some possible tests for a given application are to 
be examined on the basis of their operating characteristics, it seems advisable 
to restrict consideration to the smallest known complete class of tests, except 
possibly where computational difficulties make this impractical. 


8. Tests of composite hypotheses. The methods of proof of the theorems and 
corollaries above can be used to reach certain conclusions concerning tests of 
composite hypotheses on distributions of the form of p,(t). Let Ho now specify 
y €w, where w consists of two or more points. 

From the proof of Theorem 1 we conclude that V contains at least all of the 


Bayes’ acceptance regions for Hy corresponding to ¢’s such that / di(y) is 
0 


equal to the saltus of £ at some point y in w’; that is, V-B = 0. 

From the proof of Theorem 2 we conclude that, when Assumption 1 is satis- 
fied with y° some point in w’, then V c B. 

For any 4, rs(y) is a continuous function of y, except at y°. Suppose that do 
is admissible for testing {y°} against w’ = Y — {y°}. Let w* be a subset of 
w’ having k-dimensional Lebesgue measure zero. Then 6) remains admissible 
for testing {y°} against V—{y°}—w*, and also for testing {y°}+w* against 
v— ly} —o*. 

Theorem 3 is valid when H, is composite. The proof of Theorem 4 shows that 
when Assumptions 2 and 3 are satisfied, neither of any pair of distinct tests in 
V’ is uniformly as good as the other; hence when H, is composite, any essentially 
complete class will contain V’ or an equivalent class. 

Lehmann [10] has defined a class of ‘‘monotone critical regions.” As some exam- 
ples in the following section will show, when Assumptions 2 and 3 are satisfied 
these tests are admissible and in some cases are also likelihood ratio tests. 


9. Likelihood ratio tests. A likelihood ratio test of a (simple or composite) 
hypothesis Hy : ¥ ¢w against an alternative H, : y ¢ w’ has the following form: 
Reject Hp if and only if A(t) < K, where 

A(t) = sup py(t)/ sup p,(t) 
yew? ¥e(wl+w’) 
and K is a constant, 0 < K < 1. Let Ax(w’, w + w’) denote the acceptance 
region of such a test. Then 
Ax(w, w + w’) = {t| sup p(t)= K- sup pylt), teT} 
yew ) 


¥e(w2+w/ 


U {t|pyo(t)= K- sup pt), teT} 
0 ye(w+w’) 


v’’ew 


U MN = {t| py -(t) = K-py-(t), te T}. 


v’’eo y’e(w+w’) 





COMPLETE CLASSES 33 


[These relations are independent of the form of p,(t). They generalize a remark of 
Neyman and Pearson ([11], p. 282). They provide a convenient construction of 
likelihood ratio tests in some cases in which the usual calcuius methods fail or are 
cumbersome, as will be illustrated in an example below.] 

, Assume now that p,(t) has the form assumed above. If w’ consists of the point 
y then 


Ax(w, wo +’) = Ni , te |pyo(t) = K-py(t), teT} 


¥'e( w+ 


oe Wid w! — Wilts 2 log K — (Yo — yo), te T}. 
Thus Ax(w’, w + w’) is a set-theoretic product of T and a set of “linear half- 
spaces” of 7’. Hence Ax ¢ V. Hence we conclude that the likelihood ratio tests 
of simple hypotheses are admissible if Assumption 1 or Assumption 2 holds. 
For certain cases in which Hp is composite it will again turn out that 


Ax(w’, w +o’) ¢ V, 


so that the likelihood ratio test is admissible under the appropriate assumptions. 
EXAMPLE 1. Let py(t) = (1/2x) exp [—4)53 (t; — y,)")]. If Ho and H; are 
simple and (¥} , ¥2) = (0, 0), then 


Ax(w’,w +’) = {(b t) | 2» (—yits) = log K — 4(yr + wh, 


This is a half-plane bounded by a line whose directed distance from the origin is 
= flog K — $(y1 + ¥2')]/V/vi + v2". If now we take 


wo’ = {(Wr, v2) | Yi + = oY + 2}, 


according to the relations above Ax(w, w + w’) will be the common part of all 
half-planes whose boundaries have directed distance d from the origin; that is 


Axa, o +o’) = {(h, 4) |+6 S dh. 


If next we take w’ to be W — w’, where W is the (y; , ¥2)-plane, Axa’, w + w’) 
will be the common part of a family of sets of the form iG to) |ti + & Sd} 
and so will itself be a set of this form. If finally we take w as any set in WV, with 
w’ its complement, we obtain that in this general case Ax(w’, w + w’) = 
Ax(w’, W), the set of points (t, , ) whose distance from the set w’ does not exceed 
a certain constant c. 

For example, if w = {(¥1, ¥2) | one or both ¥; S 0}, then Axg(w’, VW) = {(t, 
t.) | one or both ¢; S c}. 

If w = {(ti, ¥2) | both y; < 0}, then Ax(w, ¥) = {(h, &)|(h Sc, & S 0), 
or (4 50, &Sc)or(fi4>0, >0, V&+ 8s 0)}. 

A sufficient (but not necessary) condition that Ax(w’, ¥) be convex is that w” 
be convex. If w’ is any convex set the methods of sections 7 and 8 show that the 
likelihood ratio test of Hy is admissible. 
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EXAMPLE 2. Consider the problem of testing whether a given ranking of the 
means of k normal populations with known variances is correct. Let 


ta ag ly : 
pt) = Qn exp | 5 x (t; — ys) |. 
Let Ho specify that ¥; = y2 = --- = yx. For simplicity, let 


k=3, w= (h—t)/V2, » = (bh —- b)/V2. 


Then, as y = (y:, yz) is a sufficient statistic for » = (Wi—-ye, + Yo—wWs), we 
may take 


p(y) = 4x) exp [—3[(y — 1)” — (i — m)(y2 — 2) + (yz — v2)'Jl, 
and write Hy : v; = 0 fori = 1, 2. Using the expressions above, it is easily seen 
that Ax(w’, V) is the set of points (y: , y2) swept out by an ellipse of the form 

(yr — 1) — (yr — 1)(y2 — 2) + (Ye — 2)” =, 
as its center (v; , v2.) sweeps throughout the first quadrant; that is 


Ax(w, ¥) = {(y1, ye) | forsome =0, v2 = 0, 
(y: — 1)" — (yr — 1)(y2 — v2) + (y2 — »)* S c} 
={(n,w)|Mmz—-Ve, »20),or(2=—Ve, m2 0), 
or (yi<0, yw <0, yi-—yyty: So)}. 


As in the preceding example we see that the likelihood ratio tests of Hy are admis- 
sible. Since this test’s maximum Type I error & is attained when » = », = 0, 
by use of tables of the bivariate normal distribution the constant c can be se- 
lected to give & any desired value. 


10. The discrete case. The developments of the preceding sections can also 
be carried through in the main when p,(¢) is a discrete probability distribution 
function. Regular convergence in the general case is defined (as in [6], p. 134) as 
follows: lim;.... 5; = 5) in the regular sense if, for every bounded subset R of T, 


tim f 5.( du(t) = [ (0) du 


0 


The proof of Theorem 1 above, with p,(t) taken to be discrete, gives 

THEOREM 1*. Every essentially unique (in — measure) Bayes’ acceptance region 
is contained in V’. 

We define the class of tests V* as follows: 6 « V* if and only if there exists an 
open convex set S such that 


0 ¢ an interior point of S, 
a(t) = 


\1 tan exterior point of S. 





COMPLETE CLASSES 


Then the proof of Theorem 1 above together with Theorem 5.5 of [6] gives 

Coro.uary 1*. If w’ is closed and bounded, V* is a complete class. 

Since V* is closed in the sense of regular convergence, from Theorem 5.7 of 
[6] we obtain 

Coro.uary 2*. V* is an essentially complete class. 

From the methods of proof of Theorem 2 above we obtain in the discrete case 

THEOREM 2*. V’ is contained in B if Assumption 1 is satisfied. 

In the discrete case Assumption 2 is always satisfied trivially unless T con- 
tains at least one convergent sequence ard its limit point. From the methods of 
proof of Theorems 3 and 4 above, we obtain 

THEOREM 3*. Jf Assumptions 1 and 2 are satisfied, and if A’ and A” are distinct 
tests in V; , then neither test is uniformly as good as the other. 

A modification of Assumption 3 is necessary for the discrete case 

AssuMPTION 3*. For any T” and ?’ as defined in Assumption 3, w’ contains a 
sequence of points y‘ such that 


lim; +0 pys(t’)/ Dicer: pys(t) = &. 


Tueorem 4*. If Assumptions 2 and 3* are satisfied, then neither of any pair of 
distinct tests in V' is uniformly as good as the other. 

Finally, using the methods of proof of Theorems 3 and 4, and defining V? as 
the subclass of V* consisting of those tests 6 for which the set {t| 6(¢) < 1} is 
bounded, we obtain 

THEOREM 3a*. Jf Assumptions 1 and 2 are satisfied, then neither of any pair of 
distinct tests in Vp , at least one of which is in Vi, is uniformly as good as the 
other. 

Coro.tuary. If T is bounded and Assumptions 1 and 2 are satisfied, every test in 
V’ is admissible. 

THEOREM 4a*. If Assumptions 2 and 3* are satisfied, then neither of any pair of 
distinct tests in V*, at least one of which is in V’, is uniformly as good as the other. 

Coro.uary. If Assumptions 2 and 3* are satisfied, then every test in V’ is ad- 
missible. 

EXAMPLE 1. Let @ = (p:, pe), and 


fut) = Pipe" — pa — pn) h = 0,1, -+- (n — &), 
' thlti(n — th — t)! . tp = 0,1,--- 0. 


We may write 


fot) = pylt) = RESP Lvah + vale — n log (et + ef9)} 
6 = Py = 


ty! te! (n — th — &)! 
where y; = log [p;/(1 — pi — pe)] fori = 1, 2. For 

Ho: (~1,~) = (pi, p2), Pi>O, pp >O0, pitp <1, 
T is bounded, and & is, trivially, continuous on 


T = {(4,4)|4 =0,1,---,(— &); tf = 0,1, ---,n}. 
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Hence Assumptions 1 and 2 are satisfied, and from the Corollary to Theorem 
3a* we conclude that an admissible acceptance region for Hy is given by the 
common part of 7’ and any convex set. 

EXAMPLE 2. Let x; and x, have independent Poisson distributions, with un- 
known respective means \,; and d.. Let t = (2, 22), and consider 


Ho: @ = (Ar, Ax) = (At, AQ), 4 >0, i=1,2. 


Let T = (a, 22) with x; = 0,1, --- , fori = 1, 2. Let A be the common part 
of T and any convex set. Then as in the preceding example we conclude that A 
is admissible. 
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ASYMPTOTIC SOLUTIONS OF THE COMPOUND DECISION PROBLEM 
FOR TWO COMPLETELY SPECIFIED DISTRIBUTIONS' 


By James F. HANNAN AND HERBERT ROBBINS 
Michigan State College and Columbia University 


1. Summary. A compound decision problem consists of the simultaneous 
consideration of n decision problems having identical formal structure. Decision 
functions are allowed to depend on the data from all n components. The risk 
is taken to be the average of the resulting risks in the component problems. A 
heuristic argument for the existence of good asymptotic solutions was given 
by Robbins ([1] Sec. 6) and was preceded by an example (component decisions 
between N(—1,1) and N(1,1)) exhibiting, for sufficiently large n, a decision 
function whose risk was uniformly close to the envelope risk function of “‘simple”’ 
decision functions. 

The present paper considers the class of problems where the components in- 
volve decision between any two completely specified distributions, with the risk 
taken to be the weighted probability of wrong decision. For all sufficiently large 
n, decision functions are found whose risks are uniformly close to the envelope 
risk function of “invariant” decision functions. 


2. Statement and reduction of the problem. The problem of testing a simple 


statistical hypothesis against a simple alternative can be formulated as follows. 
Let x be a random variable (of arbitrary dimensionality) which is known to have 
one of the two distinct distribution functions F(z, 6) for @ = 0 or 1. On the basis 
of a single observation on x (we consider only the nonsequential case) it is re- 
quire to decide whether the true value of the unknown parameter @ is 0 or 1. 

Statistical decision problems of the same formal structure often occur, or can 
be considered, in large groups. We shall, therefore, take as a single entity the 
following compound decision problem. Let n be a fixed positive integer and let 
%,,°**, 2%, be independent random variables, each of which has the distri- 
bution function F(x, 6) with respective parameter values # , --- , 0, , with 0; = 
0 or 1. Let x = (a%,°--,2n) denote the vector of observations and 
6 = (6, --- , 6.) the unknown vector of parameters; 6 is known.to belong to the 
set 2 consisting of all 2” possible vectors of n components, each 0 or 1. On the 
basis of x it is required to decide the true value of 6, which amounts to deciding 
for every i = 1, --- ,n whether 6; = Oor 1. 

Any vector of n functions t = (4(x), --- , én(x) is a (randomized) decision 
function for the compound decision problem if for i = 1,---,n,O0 
t,(x) < 1, and if the conditional probabilities, given x, of deciding that 0; = 0 
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or 1 are respectively 1 — ¢,(x) and ¢,(x). If for some function ¢(x), ¢(x) = 
t(z;) for i = 1, ---, n, then t will be called simple and will be denoted by t. 
We assume the practical background of the problem provides two positive 
constants, 
a, the loss incurred in deciding “6; = 0’’ when the true value of 6; = 1, 
b, the loss incurred in deciding “‘@; = 1’? when the true value of 6; = 0. 
For any Borel set B we define 


(2.1) w(B) = | dF Ce, 6, 6= 0,1; 


(2.2) w(B) = yo(B) + wi(B). 


Since ;» and yw; are absolutely continuous with respect to the finite measure y, 
generalized probability density functions f(z, 0) and f(z, 1) exist such that for 
any Borel set B 


w(B) = | $x, 6) du, for 6 = 0,1. 
We note that the relation 
(2.3) f(x, 0) + f(z, 1) = 1, a.e. (yu), 
is obtainable from the identity in Borel B, 


fa du = p(B) = pwo(B) + w(B) = [ ue, 0) + f(x, 1)) dp. 


The joint generalized probability density function of x with respect to the 
product measure »”, when the parameter vector is 6 = (@,, --- 6,), is f(x, 6) = 
[1 ?/(a:, @,). The expected loss on the ith decision in using a decision function 
t = (t(x),---, é(x)) is, fori = 1,---, n, 


Ri(t, 0) = f [a0.(1 — t(x)) + 01 — 6tCx)1fCx, 0) da” 


The average expected loss on all n decisions, which we define to be the risk of t, 
is therefore 


(24) R(t, 0) = + > Ri(t,0) = f 5 >» {aol — t(x)] + b(1 — ,)ts(x)} f(x, 0) du”. 


This is equivalent to defining the loss of the decision d = (d,,--- , d,) in Q, 
given 6 in 2, to be 


W(4, 6) = ‘> [a9,(1 — di) + 0(1 — 8) di), 


since this definition implies that the decision function t induces the conditional 
(for fixed x) expected loss 


(2.5) Wit(x), 0) = 1D fan.lt — tx)] + B(1 — 0:)4CH)). 


: 
n 
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By the remark (2.3), f(x, 6) is expressible as 
(2.6) f(x, 0) = TT sx, 6.) = TT tosfles, 1) + (1 = 001 — fle, DI 


The Halmos-Savage [2] form of the theorem linking sufficient statistics and 
density factorization shows that (f(z, 1), --- , f(an, 1)) is a sufficient statistic 


for 6 in Q. Let 

Z = (21, -+* , Zn), 2: = f(z;, 1); 
v(T) = p(x |f(z,1)in J), forall Borelsets7; 6 =0,1; 
LAD ir vo(I) + vi(I). 

It is easily verified (see [3] Sec. 32) that the sufficient statistic z (and, conse- 
quently, the measures » , », and v) is independent of the choice (2.2) of an 
underlying measure yp relative to which yo and yw: are absolutely continuous. 


We note that z has, with respect to the product measure »”, the generalized 
probability density 


(2.8) d(z, 0) = II oe: + (1 — 01 — 2). 


(2.7) 


Returning to (2.4) we see that the vector of conditional expectations 
E{t(x) | z] = (EA) | z], «++ , Eltn(x) | z}) 


is a decision rule having the same risk as t. We denote this rule by t(z) = (4(z), 
-++ , t,(z)) and, using (2.5) express its risk, 


Rit, @) / Wt(z), ©) d(z, ) do” 


234, [ (1 — da) ale, 0)” +23 1-0) 
nm 1 nr 1 


: / t(z) d(z, @) do”. 


3. Simple decision functions. If t = ¢ is a simple decision function, then (2.9) 
simplifies to 


(3.1) Rit.) = * 3) [a - ew + . > (1 — 0) f te)(1 — 2) a. 


Setting 6 = (1/n)>>0; = proportion of 1’s among the n components of 6, we can 
write (3.1) in the form 


(3.2) R(t, 6) = / ab(1 — t(z))e + b(1 — 8)t(2)(1 — 2) do. 
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The value 6 is necessarily rational, of the form k/n for k = 0, --- , n. We now 
define for any real number p such that 0 S p S 1, and any »-measurable function 
t(z) such that 0 s ¢(z) S 1, the expression 
(3.3) Bit, p) = | apa — t(z))z + b(1 — p)i(z)(1 — z) dy. 

Thus (3.2) becomes 
(3.4) R(t, 6) = B(t, 6). 


From (3.3) it is clear that for any fixed p, B(t, p) is a minimum if and only if for 
almost every (v)z, t(z) is of the form 


1, if apz > b(1 — p)(1 — 2); 
(3.5) t,(z) = <0, if apz < b(1 — p)(1 — 2); 
\arbitrary, if apz = b(1 — p)(1 — 2). 


The minimum value of B(t, p) is 


o(p) = Bit,, p) = [ min lapz, b(1 — p)(1 — z)] dp 


(3.6) ~C(p) C(p) 
= ap i dv, + v(1 — p) (1 _ an) 


where C(p) = b(1 — p) / [ap + b(1 — p)] for 0 S p S 1. It follows from (3.4) 
that, for any simple decision function ¢ and any 6 in Q, 


(3.7) R(t, 0) = $(6), 


equality holding if and only if ¢(z) is of the form (3.5) with p = @. 
We shall now establish some properties of the function ¢(p) defined for 0 < 
p = 1by (3.6). ForO0 S p: < m SF 1l,and0 <s <1, 


s minfapiz, b(1 — pi)(1 — z)} + (1 — 8) minfap.z, b(1 — p.)(1 — 2)] 
miniasp,z, bs(l — pi)(1 — z)] 
+ min{a(1 — s)poz, b(1 — s)(1 — m)(1 — z)]} 
S min{a{sp; + (1 — s)po}z, b{1 — sp. — (1 — s)pe}(1 — z)], 


with strict inequality if and only if p, < C(z) < pe (or alternatively C(p.) < 
z < C(p,)). Integrating with respect to v we obtain from (3.6) that ¢ is a con- 
cave function of p, 


(3.8) so(pi) + (1 — 8s) (pe) S o(spr + (1 — 8)p2), 


with equality if and only if »[z | C(p.) < z < C(p:)] = 0. Since ¢(0) = (1) = 0, 
this implies 


(3.9) o(p) > 0, 0<p<il, unless r[z|0 < z < 1] = 0. 
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The exception here is the trivial case where » and »; (and hence yo and y) are 
disjoint measures. 

The continuity of ¢(p) can be established in the following form. If 0 < p < p’ 
< 1, thenO S C(p’) < C(p) S 1 and 


minfazp, b(1 — z)(1 — p)] — minfazp’, b(1 — z)(1 — p’)] 
—az(p’ — p), 0<2< Cp’); 
= {b(1 — z)(1 — p) —azp’, = C(p’) Sz S C(p); 
b(1 — z)(p’ — p), C(p) <z 81. 
Hence it follows that, for0 S z S$ 1, 
— az(p’ — p) S minfazp, b(1 — z)(1 — p)] — minfazp’, b(1 — z)(1 — p’)) 
S b(1 — z)(p’ — p). 
Integrating with respect to », we obtain 
(3.10) —a(p’ — p) S$ o(p) — o(p’) S b(p’ — p), p’ > p. 
Interchanging p and p’, multiplying by —1 achieves 
(3.11) —b(p — p’) S o(p) — o(p’) S ap — p’), p’ <p. 
From (3.3) we have, for any 0 S p, p’ S 1, 


Blty, p’) — o(p) = f (p! — p)lald — t5(2))2 — btg(2)(1 — 2)} dy 


(’ — p) f {ald — t4(2))z — btg(2)(1 — 2)} dy, 


[o —p)a, p'>p; 
— \p— pb, pp’ <p. 
The last three inequalities, (3.10) to (3.12), and the definition of ¢ imply 


0 < Bip, p’) — o(p’) S (a +b) |p — p’|. 
From (3.4) it follows that for any 0 S p S 1 and any 6 in Q, 
0 Ss Rit,, 6) — (6) S (a + bd) |p — 8|. 


Thus, we have proved 

THEOREM 1. Suppose that in some manner an approximate value p of the true 
proportion @ is known. Then the statistician who uses the simple decision function 
t = t, will achieve a risk R(t, , 8) which is within (a + b) | p — 6| of the minimum 
attainable risk (6) in the class of all simple decision functions. 


4. “Consistent” estimation of a proportion. We use (without loss of generality) 
the canonical form of the problem (see (2.6) to (2.9)), assuming only that the 
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original measures, yo and 4; , are not identical. Thus we are concerned with the 
random vector z = (z,,---, zn) having the density d(z, 6) defined by (2.8). 
We consider the problem of finding an estimator p,(z) for the proportion 6 of 
1’s in the first n coordinates of 0. 

Since our principal interest is in the asymptotic estimation problem, we will 
consider the sequence of problems defined for n = 1, 2, --- as embedded in the 
probability space of infinite sequences z = (2, 22, --- ) with p-measure in- 
duced by the density d(z, @) defined on the first n coordinates of z and @, re- 
spectively. We emphasize this aspect in this and the following section by re- 
ferring to @ in Q,, . 

Avoiding a discussion of “optimum” estimation, we devote this section to the 
consideration of a subclass H of the class U of all unbiased estimators of 6. 
This subclass H is to be the class of all estimators of the form 


(4.1) Kz) = 2 p> n(zi), 


where h(z) is an unbiased estimator of @. 
As a measure of the risk of an estimator in H we use its variance, 


(4.2) n Var h(z) = 6 Vi(h) + (1 — 8) Vola), 


where V,(h) = / (h(z) — 1)? dy, and Vo(h) = / (h(z))? dv. We single out an 


interesting subclass of H by investigating the existence and representation of 
elements A minimizing, for fixed p, with 0 < p < 1, 


(4.3) pVi(h) + (1 — p)Vo(h). 
For any pair of real numbers \ = (Ao , A1) we define an extension of (4.3) to the 


set of all g(z) such that / Ig(z)| dv < @ 


Fy(g) = p| [ éan- i]+a - ») [fan -2| foan—1 


—2o [o dv. 


(4.4) 


Using the density representation of these integrals and the restriction on the 
domain of g, we have 


Fila) = f oedlpe + (1 — A — 2) — 2g(@)Daz + 1 — 2) 
(4.5) 


-dy => + 21 e 
For fixed Xo and ); the integrand hereis a minimum, for each fixed z, if and only if 


Mz + Aol — 2) 


(4.6) g(z) = gp(z|A) = pz + (1 — pi — 2) , 


a. e. (v). 
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Since g,(z|) S max [|Ai|, |Ao|] / min [p, 1 — p], we find that g,(z| A) is a 
unique (v) minimum of F,(g) over its domain. If there exists a determination of 
Xo and A; such that g,(z| A) is an unbiased estimator of 6, we will denote it by 
h,(z). Then we have for all unbiased h 


(4.7) pVi(h) + (1 — p)Vo(h) = Fy(h) &> Falhy) = pVilhy) + (1 — p)Volh,), 


where equality holds only if h(z) = h,(z) (vr). 
The estimator g,(z | p) will be unbiased if \» and \, satisfy 


2 l—s i 
ag *l weacmeca”** | sea spent 


i = 0,1- 
The determinant of these equations is 


LJ pe Fae =%) a] er. i Ae -aT 


of pec 
pe+(i—pii—z 


It is nonpositive by the Schwarz inequality. If it is equal to zero, z and 1 — z 
are linearly dependent a.e. (v). Since z and 1 — z are densities, linear dependence 
would imply that ») and » are identical; this possibility has been excluded here. 

Thus, an explicit representation of estimators in H, minimizing (4.2) for 


@ such that @ = p, is obtained as 
h(a) = = > hy(ei) 0<p<l, 


where h,(z) = g,p(z| A), and A is a solution of (4.8). This class of estimators 
merits our interest since each is admissible relative to H and each satisfies the 
following theorem. 


Tueorem 2. Let h(z) be any estimator in H such that \h(z)| + 1 < M < o. 
Define 


0, h(z) < 0; 
Dalz) = 4h(z), 0 < A(z) <1; 
1, i< h(z). 


Then, (a) 0 S pa(z) S 1, and (b) for any « > O there exists an N(e) such that, 
for any @ in Q,, , 
Pri|pa(z) — 6| > € for some n = N()] S «. 
Proor. It will clearly be sufficient to show that h(z) satisfies part (b). For this 
purpose we introduce h,(k) for i = 0 or 1 and k = 1, 2, --- to denote the arith- 


metic mean of k independent random variables, each having the probability 
measure v;h’. We express 


h(z) = (1/n)>-[6;h(z;) + (1 — 0,)h(2;)] 
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(4.9) 6D Orle;)/DL0; + (1 — BL — O)hle;)/DUA — 45) 
6hy(nd) + (1 — B)ho(n — nb), 

(4.10) A(z) — 6 = B[h(nd) — 1] + (1 — Bho(n — nd). 

The strong law of large numbers yields the existence of functions Ni(n) and 

No(n), defined for » > 0 and such that 


(4.11) Pr{jh(k) — i] > 9 for some k = N,(n)] S 2, +=0,1. 


_We fix « > 0 and consider the term 6{/,(n@) — 1] of (4.10). Since @ < 1 and 
\hi(n8) — 1| S M, we have 


(4.12) |O{hx(n6) — 1)|S min {6M, |hi(nd) — 1)}. 


Hence, for any fixed integer N and any fixed point 6 in Q,, , if z is such that there 
exist n, = N with 6[hi(n,0) — 1] > €/2, then 


nO > nzM'e/2, \hi(n,6) — 1| > €/2. 
Hence there exists k > NM™~‘e/2 such that \hi(k) — 1| > €/2. Consequently 
Pr{ 6[hi(n6) — 1] > ¢«/2 for some n = N} 
S Pr{\hi(k) — 1| > «/2 for some k > NM “e/2}. 


Thus, if N => 2Me'N,(e/2), it follows from (4.11) for i = 1 that the right side 
of (4.13) is less than ¢/2 uniformly for all 6 in Q, . 

We can deal in a similar fashion with the term (1 — 6)ho(n — né@) of (4.10). 
Thus we obtain that part (6) is satisfied by 


(4.14) N(e) = 2Me™ max [Ni(€/2), No(e/2)]. 


5. Nonsimple decision functions t. We have seen in Section 3 that if p is a 
good approximation to 6, then the simple decision function t = t, (see (3.5)) 
does about as well as is possible for any simple decision function. Although a 
good approximation p to 6 is not generally available to the statistician, we have 
seen in Section 4 that for large n a good estimator p,(z) of 8 is always available. 

It is natural to combine these two results by using the decision function ¢, with 
the constant p replaced by the random variable p,(z). This amounts to using the 
nonsimple decision function (* = (tT(z), «++ , #2(z)) such that for i = 1, --- ,n, 


(4.13) 


if z; > C(p,(z)), 


1 
(5.1) t*(z) = | ‘ 


\0, otherwise. 


(We have chosen, arbitrarily, one way of resolving the ambiguity in the definition 
(3.5) when z = C(p).) 
In practice, t* can be used only when all the values z,,--- , z, are known 
before the individual decisions on the values of 6;,--- , 0, have to be made. 
We shall now investigate the behavior, for large n, of the risk function R(t*, 6). 
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We begin by considering the loss of the decision rule t, (determined by (3.5) 


and by t,(C(p)) = 0), where z is observed and @ is the true parameter point. 
From (2.5) we obtain 


Wt,(z), ©) = a> 50,(1 — t,(z,)) / 50.) 
(5.2) + b(1 — d(C — 6Dé,(z) /LA — 4,)] 
a6S,(C(p) | n@) + b(1 — 4)[1 — S(C(p) | n — né)], 


where S,(v|k) is the sample distribution function of k independent random 
variables, each distributed with probability measure »; fori = 0 or 1 and k = 1, 
2,--- . For future use we define 


(5.3) Di(k) = sup | Si(o |) - [ an], Do(k) = sup | dvy — Sot) | 
Osvsl 0 Osvs1 Lo 
Using an alternative form of (3.3), it follows from (5.2) that 


C(p) 
W(t,(z), 6) = ad {s(c) | nb) - in} 


C(p) 
+618) {/° dn — S(CCp)|n — ni} + Bly, 0) 
Hence, from (5.3) and Theorem 1, 
W(tp(z), ®) < adD{ (nd) + b(1 — 6)Do(n — nd) + (6) + (a + b) |p — |. 


Since this holds for each O S p S 1 we have, for any estimate p,(z) satisfying 
(a) of Theorem 1, 


(5.4) Wty, (z), ®) S abDi(né) 
+ b(1 — 6)Do(n — nd) + $(6) + (a + b) |palz) — 4]. 
By the Glivenko-Cantelli Theorem [4] 
Pr (him Di(k) = 0] = Pr (lim Dok) = 0} = 1. 
This is equivalent to the existence of functions N{(n) and N o(n), defined for 
n > 0, such that 
Pr[Di(k) > n for some k = Ni(n)] S 2, 
Pr{Do(k) > » for some k = Ne(n)] S 2. 
As in (4.11) to (4.14), we have that if 
N*(e) = 2€* max[aN7(¢/2), bNo(¢/2)), «> 0, 
then, for any 6inQ,.., 


(5.5) PrlaéD{(né) + b(1 — 6)Do(n — nb) > e€ for some n = N*(e)] S «. 
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Returning to (5.4) we see that, for any p,(z) satisfying the conclusion of 
Theorem 2, (5.5) and Theorem 2 combine to furnish for any « > 0 


mo(e) = max[N*(c/2), N(«/2(a + b))] 
such that, for any 6 in Q,, , 


(5.6) Pr{ W(t,)(z), ©) — ¢(@) > «for some n = m(e)} S «. 


The argument from (5.2) onward proves 
THeoreM 3. If p,(z) satifies the conclusions (a) and (b) of Theorem 2, then the 


decision function t* defined by (5.1) is such that to any « > 0 there corresponds an 
m(€) such that for any 8 in 2, 


Pr{W(t*(z), ®) < $(6) + efor alln = m(e)} > 1 —. 


Since W(t*(z), 6) S max [a, b], Theorem 3 implies 
TueoreM 4. Under the assumptions of Theorem 3, t* is such that to any e > 0 
there corresponds an n;(e) such that for any n = m(e) and any 6 in Q, 
R(t*, @) < (6) + «. 
Thus, t* is a nonsimple decision function which for large n does about as well 
as could be done by any simple decision function even if 4 were known exactly. 


6. Invariant and R-invariant decision functions. Let (P(1), ---, P(n)) be 
an arbitrary permutation of (1,---, mn). Define, for any real vector 


E= (fi, ee » a), 
(6.1) PE = (Eq, +++ , Erm). 


From (2.5) and (2.8) we note that W(Pt, P66) = W(t, 6) and d(Pz, Pé) = 
d(z, 6). From (2.9) we obtain for any decision function t, by a change of variable 
of integration, 


R(t, Pe) = / Wt(z), Pe) d(z, Pe) do” 
(6.2) 
1 / W(t(Pz), Pe) d(Pz, Pe) de” = R(P™P, 6). 


We call a decision function t invariant if PtP = t for all P. We denote by 
R-invariant a decision function t such that 


(6.3) R(P"tP, 6) = R(t, 8), for all P and 0. 


The risk of an R-invariant decision function can be expressed as an explicit 


function of 6 by formally averaging the representation (2.9) over all P. From 
(2.9), (6.2), and (6.3), 


(64) R(t, ©) = = DRE, Po) = =D | Witte), Po) alz, Po) a 


n 
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Changing the order of summations and integration, we find that if t is R-in- 
variant its risk, R(t, 6), is expressible in the form 


rt) =1¥ f fet— 1 = HE) & arco dle, PO) 
(65) 
b = 2X (1 — Gro) ale, Pa)} dy 


For any real vector r = (ri, --- , Tn) we define for every integer k 


LDU rw IL 1 - ro) k = 0,1, --+,n; 


L({k, n, tr) = n| 
0, otherwise; 
L({k,n — li;= L{k, n — 1, (n, 7°? Feng tte yg °°” »Tn)), i= 1, 2, v2 ge 
Then 
D Or dz, P0) = 2; Do II lOrcnz; + (1 — Or)(1 — 2;)) 
P Opcgyml jxsi 
(Da) (n — DiL( da —-1, »—1, i); 
1 1 
x (1 — Op.) d(z, P6) = (1 — 2) x (1 — @,)(n — 1)! 


(6.7) L (& i a 2 i) 


R(t,0) = 1% f {alt — tdaiedL(nd -— 1, n— 1, 5) 


(6.6) 


It follows from (6.5) that for R-invariant t 


(6.8) 
+ bi{z)(1 — 2)(1 — 4)L(nb, n — 1, &)} db”. 

Denoting the ith summand of (6.8) by R,(t | 6), we note for later use that, if t 

is actually invariant, 

(6.9) Rit | 6) = Ri(t| 6) = R(t, 6), 


This follows from the invariance and a permutation of the variables of integra- 
tion in the representation of R,(t | 6) in (6.8). It further follows from this repre- 
sentation that, for any fixed 6, the integrand of R,(t | @) is, for each fixed z, at a 
minimum with respect to ¢; if and only if ¢; is of the form defined, for p = 0, 
1/n, ae (n - 1)/n, 1, by 


1, ) > | 


(6.10) t,(z) = <0, | azipL(np — 1,4 < bo ~ pe — p) ' 
-L(np, n-1, &), 


a= 1, 4) | 


arbitrary, = 
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with p equal to 6. We denote (t(z), --- , tnp(z)) by t,. With a proper determi- 
nation of the arbitrary part, any decision function of this form (6.10) is invariant. 
Hence, the representation of its risk in the form (6.8) is valid and R(t, 6) for 
each fixed @ is minimized over the class of R-invariant decision functions by an 
invariant decision function of the form (6.10). 

Let 


(6.11) on(6) = inf R(t, 6). 


R-invariantt 


From (6.8), (6.9), and (6.10) we obtain 
on(9) = R,(ta| 4) 


(6.12) / min [az,di(nb — 1, n — 1, a), 


b(1 — al — B)L(nd, n—1, &)] db”. 


Since L(k, n — 1, 4%) is a symmetric function of z,---, z,, we have for 
any symmetric measurable set S 


(6.13) | Lk, n—1, &) @" = vt *(5). 


It follows that the integral with respect to z., --- , 2n of a 2:-section of the inte- 
grand of (6.12) is 


azy8{1 — vfs ""(S,,)] + b(L — 2i)(1 — 8) vf’ "%(S,,) 

where S,, is the symmetric set 

S., = [(ze, °°, 2n) | azdL(nd — 1, n—1, &) 

> b(1 — a)(1 — 8)L(nd, n—1, 4). 


The developments from (6.4) onward set the stage for 
TueoreM 5. If (6) and $,(8) are defined by (3.6) and (6.12), respectively, then 
for any « > 0 there exists N(¢) such that for any n 2 N(e«) and any 6 


o(6) — € < on(6) S (8). 


Proor. That ¢, S ¢ for all 6 follows from the fact that every simple decision 
function is invariant. 

For the nontrivial part of the proof we fix « > 0. From the continuity of 
¢(p) ((8.10) and (3.11)) we obtain a 5(e) such that 


(6.14) o(p) —e <0 ifp<6 orp>1-— 4. 


Thus, it will be sufficient to show the existence of an N(¢) which suffices for the 
theorem when 0 < 6 S 6 S 1 — 6. We will obtain this from the following measure 
theoretic lemma, a slight generalization of which is proved in [5]. 





COMPOUND DECISION PROBLEM 49 


Lemma. If mp and m, are nondisjoint p-measures on a o-algebra of subsets x of 
a set X, then for every «, 6 > O there exists N(e, 6) such that for any pair of posi- 
tive integers r,s withr +s = N(e,6) andé S r/(r + 8) $1 — 6, 


\mgmi(S) — ms ‘mi**(S)| < € uniformly for all symmetric S in x"**. 


From this lemma we obtain that if n — 1 = N(n, 6*) and 6* < n6/(n — 1) 
ci 2 
[1 — vf 95-""(S,,)] + vf ot *"(S,,) > 1 — 9 


uniformly for all z,. From this it follows that ¢,(6) > (1 — 7)¢(@) = o(8@) — 
no(6). Since the max,¢(p) S c = ab/ (a + b), we see that in view of (6.14) the 
choice N(e) = N(c™'e, 2-*8(e)) will complete the proof of Theorem 5. 

Theorem 5 can be combined with Theorem 3 or Theorem 4 to give a strength- 
ened endorsement of t*. For large n, t* does about as well as could be done by 
any R-invariant decision function even if 6 were known exactly. 


7. Bayes’ and minimax solutions. Let t = (4(z), --- , t,(z)) be any decision 


function in the compound decision problem. For any 6 in 2 we can write the risk 
(2.9) in the form 


R(t, 6) = / = > {a6,{1 — t,(z)] d(z, ) + b(1 — 0,)t{z) d(z, 6)} do”. 


By a weight function we mean any function 8(6) 2 0 defined on 2 and not 
identically 0. For any weight function 8(6) and any decision function t we de- 
fine the weighted risk of t relative to 8(@) as 


Bt, 6) = X aw)-Rit,o) = [> X {a - u@) aX Bode: ale, o) 
+ t(z)b a B(w)(1 — w;) d(z, w)} dv”. 


For fixed 6(6) this will be a minimum if and only if for almost every (v")z and 
foreveryi = 1,---,n, ¢,(z) is of the form 
1, ] > | 


(7.1)  4(z|B) =40, ba © aww: de, 0)) < jb D Aw)(1 — a) dla). 


\ arbitrary, = 
Any decision function t of the form (7.1) is called a Bayes’ solution relative to 
the weight function 8(6). 


For the remainder of this section we restrict our attention to symmetric 
6(6), that is, such that 


(7.2) (2) B(6) = & for all @ with >) 0; =k, k=0,1,---,n. 
1 


For symmetric 8 we obtain the representation (see (6.8) to (6.11)) 
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a >, Bla)w; d(z, o) = az; > By 2 Lk-1, n—1, 4%), 
@ k=O nN 


bX Alo)(1 — a) dz, 0) = W1 — 2) > of nat a-i id 


Several particular cases of (7.2) hold special interest for us. If for some integer 
ko withO S ki S n, (7.2) takes the form 


Be. =1, &=0 k = 0,-++ko—1, ky + 1,---, 2, 


then the corresponding Bayes’ solution (7.1) is a decision function of the form 
(6.10). 
If for some constant p with 0 < p < 1, expression (7.2) takes the form 


B= (7) p(l — p)*, 


then the corresponding Bayes’ solution (7.1) is a decision function of the form 
(3.5) provided the Bayes’ solution is required to be simple on the arbitrary part 
of its definition. 

Referring back to Section 3, we have by the previous paragraph that each of 
the simple decision functions t = ¢, for 0 < p S 1, defined by (3.5), isa Bayes’ 
solution for the compound decision problem. It can be shown (we omit the 
simple proof) that there always exists a value 0 < p’ < 1 and a determination 
of t, for which the coefficient of p in (3.3) vanishes. Letting r be the constant 
value of B(t, , p) it follows that R(t, , 6) = r for every 6 in Q. 

Since ¢, has constant risk and is a Bayes’ solution relative to a weight func- 
tion which is positive for every 6 in ©, it follows that ¢,- is the admissible minimax 
decision function, unique in the sense of risk. That is 


sup R(t, @) = minimum for t = ¢,,, 
éing 


and if t is any other decision function such that sup R(t, 6) = r, then R(t, 6) =r. 


8. Admissibility. Since the minimax decison function ¢, is simple and has 
constant risk r independent of n, it follows that 


r = R(ty, 0) = inf R(t, 0) = (0) for all 6 in Q, 


and hence r = ¢(p’) = max, ¢(p). 

If wo and yw are nondisjoint, ¢(0) = ¢(1) = 0 < r and we conclude from 
Theorem 4 that, for any 0 < ¢« < r, the minimax decision function is e-inad- 
missible (See [6] for definitions) for all sufficiently large n, since decision func- 
tions of the type t* are e-better. 

The present paper has failed to exhibit a t* which is admissible (or even to 
show the existence of such). This deficiency is remedied, at least asymptotically, 
by the fact that, for any e« > 0 Theorems 4 and 5 together imply that any de- 
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cision function of the type t* is ¢«-uniformly-best (relative to the class of R- 
invariant decision functions) for all sufficiently large n. 
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THE EFFICIENCY OF TESTS’ 


By Wassity HorEFFrpING AND JOAN Raup ROSENBLATT 
University of North Carolina 


Summary. The efficiency of a family of tests is defined. Methods for evaluat- 
ing the efficiency are discussed. The asymptotic efficiency is obtained for cer- 
tain families of tests under assumptions which imply that the sample size is 
large. 


1. Introduction. Let w\” and w~ be two tests each of which has the same 
fixed significance level for testing a hypothesis @ = 6, , and which are defined for 
every sample size n. The relative efficiency of test w\”, or rather, of the sequence 
{wy}, with respect to test w\” has been defined as the ratio n;/n2 , where nz is 
the least sample size required by a test of the sequence {w‘” } in order to achieve 
the same power for a given alternative @ = 6 as is achieved by the test in {w\” 
using a sample of size n; . This is essentially the definition used by Pitman (see 
Noether [6], p. 241). 

In Section 2 we extend this definition by replacing sequences of tests by 
arbitrary families of (nonsequential) tests and the parameters @; and @ by two 
arbitrary classes of distributions. The tests are regarded as general two-decision 
rules. If N (3) is the least sample size used by a test in family 3 whose probabilities 
of the two kinds of error (corresponding to the two classes of distributions) do 
not exceed two given numbers, the ratio N(3,)/N(3:) is defined as the relative 
efficiency of family 3. with respect to family 3; . 

In Section 3 it is pointed out that the determination of N(3) is closely related 
to finding a test which maximizes the minimum power. 

In Section 4 the problem of asymptotic efficiency is considered. In studies of 
the asymptotic efficiency of tests it is customary to consider a simple hypothesis 
6 = 6, (say) and a simple alternative, @ = @.,andtoassumethatasn— 0, 6; 
remains fixed and 6, approaches @; in a certain way, for instance by setting 
62 = 0, + kn~”*. Neither the restriction to simple hypotheses nor the assumption 
that 6, depends on n seems to be entirely adequate from the point of view of 
most applications. 

In Section 4 of this paper a somewhat different approach is used. As a typical 
special case, consider a sequence of independent random variables with common 
cdf (cumulative distribution function) F. Let 6(F) be a real-valued function of 
F, and suppose that one or the other decision is undesirable according as 
6(F) < 6, or O(F) = 6, where 6; and 6, > 6, are fixed numbers. Since 6; and 6 
usually will be so chosen that neither decision is strongly preferred when 6, < 
6(F) < 62, small values of 6. — 6, are frequently of particular interest. 
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Let N(3) denote the least sample size required by a test in family 3 for which 
the probability of a wrong decision does not exceed a if 6(F) S 6, , and does not 
exceed a, if 0(F) 2 6. Thus N(3) is a function of 6; and 6. Under suitable 
assumptions we derive asymptotic expressions for N(3) as 6 = 6, — 6, tends to 
zero, while a; and a, remain fixed. Illustrative examples are given in Section 5. 


2. The efficiency of a family of tests. Let X be a random variable or a random 
vector with cdf F, which is assumed to belong to a class € of cdfs. It is desired 
to decide, on the basis of n independent observations x, = (x1, --+ , Zn) on X, 
between two alternative courses of action, A; and A, . Let d; denote the decision 
in favor of A;, with i = 1, 2. Suppose there are given two disjoint subclasses 
€, and @, of © such that decision d; is preferred if F is in @;, fori = 1, 2. (In 
most applications one will choose the classes C; and @, in such a way that neither 
decision is strongly preferred if F is neither in @; nor in C; .) 

Consider a decision rule, briefly referred to as a test, of the following type. 
Let E, denote the space of points x, ; if x; is a vector with k components, EF, 
may be taken as the nk-dimensional Euclidean space. Let w:;, be a subset of 
E, , and denote its complement by we, . (All sets of points x, considered in this 
paper are assumed to be Borel sets, and all functions of x, are understood to be 
Borel-measurable.) A test determined by the pair of sets w, = (Win , Wen) con- 
sists in taking n observations on X, and making decision d; if the observed point 
Xx, is in wi, , fori = 1, 2. This test will be referred to as the test w, . A test w, 
with wi, C E, will be called a test based on n observations. 

Let a and a, be two positive numbers. We shall say that the test w, solves 
the problem (C; , C2, a1, a) if 


(2.1) P(X, €win| F) = 1 — a; for all F in @;, += 1,2, 


where X, = (Xi, --- , X,) is a random vector with values in Z, , and P(R | F) 
denotes the probability of relation R when X,, --- , X, are independent with 
common cdf F. 

Let 3 be a family of tests. We shall mainly be concerned with families 3 which, 
for every positive integer n, contain at least one test based on n observations. 
For example, 3 may be the family of all tests w, with 


Win = {Xa :tn(Xa) < ch, —-e <c< om, n=1,2,---. 


where {t,} is a given sequence of functions, and {x, : R} denotes the all set of 
points x, such that relation R is satisfied. 

Let N(3) = N(5, C1 , Ce , a1 , ae) be the least integer n such that the inequalities 
(2.1) are satisfied for some test in 3. Thus N(3) is the least number of observa- 
tions with which problem (C; , C2 , a: , a2) can be solved when we restrict ourselves 
to tests belonging to family 3. If no test in 3 satisfies (2.1), we set N(3) = ~. 
The number N(3) will be termed the efficiency index, or simply the indez, of fami- 
ly 3for problem (C; , C2 , a: , a2). Evidently 3 may contain more than one test 
based on N(3) observations. 





54 WASSILY HOEFFDING AND JOAN RAUP ROSENBLATT 


If 3, and 3, are two families of tests and at least one of the indices N(3,;) = 
N(3; , Ci , C2 , a1, a2), for i = 1, 2, is finite, the ratio 


eff (51/52) = N(S2)/N (31) 


will be called the efficiency of family 3, relative to family 3, for problem (C; , 
C2, a1, a). The relative efficiency can thus equal any nonnegative rational 
number or infinity. This definition of relative efficiency of two tests is an ex- 
tension of Pitman’s definition of the same term (see Noether [6], p. 241). 

Let 3* be the family of all tests w, = (win, Wen), for all n = 1, 2,---. If 
N(3*) = , problem (C; , Cz , a: , a2) has no solution (within the family 3*). If 
N(3*) < o, and 3 is any subfamily of 3*, then eff(7'/7*) may be called the 
(absolute) efficiency of family 3 for problem (@; , C2 , a: , a2), provided we con- 
fine ourselves to tests in 3*. 

Clearly, eff(3/3*) < 1, the sign of equality holding if and only if 3 contains a 
test which solves problem (C; , Cz, a:, a) and is based on the least possible 
number of observations with which the problem can be solved by any test in 3*. 

All that has been said can immediately be extended to families of randomized 
tests. A randomized test is determined by a function ¢:,(x,), where 0 S 
din(Xn) S 1. Let don = 1 — in. The test consists in taking n observations x, 
and performing a random experiment whose two possible outcomes, e; and é: , 
have probabilities ¢:,(x,) and ¢2,(x,), respectively. If event e; occurs, decision 
d; is made. A test determined by the pair of functions ¢, = (¢in , ¢2n) will be 
referred to as the test ¢, . 

If 3 is a family of randomized tests, the index N(3, @; , C2 , a1 , a2) is defined 
as the least n such that the relations 


E@n|F)2>1—a; forall Fine,, i=1,2, 


are satisfied for some ¢, in 3. Here E(@;, | F) denotes the expected value of 
din(Kn) When X,, --- , X, are independent with the common cdf F. If random- 
ized tests are admitted which do not use any observations, we could have 
N(3) = 0. This trivial case can be excluded by assuming that a; + a, < 1. 

The notion of efficiency could be extended to families of tests such that the 
choice of the number of observations also depends on a random experiment, the 
probabilities of whose outcomes may or may not depend on the observations. (In 
the former case we are dealing with sequential tests.) This paper is confined to 
families of nonsequential tests based on a nonrandom number of observations. 

So far we have assumed, to simplify the exposition, that X,, X.,---,isa 
sequence of independent, identically distributed random variables. Suppose, 
more generally, that for every n the random vector X, = (Xi, ---,X,) hasa 
cdf G, which belongs to a class €, . For every n there are given two disjoint sub- 
classes, C:, and C2, , of C,. We say that a test , = (¢1n, ¢2,) solves problem 
({Ci.}, {Con}, a1, a2) if 


E(¢in| Gn) 2 1 — ay for all G, in Cin, += 1,2, 
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where E(¢;, | G,) denotes the expected value of ¢;, (X,,) when X, has the cdf G, . 
The definitions of N(3) = N(3, {Cin}, {Cen}, a1, ae) and eff (3,/32) are obvious 
extensions of the corresponding definitions in the special case. 


3. The determination of N (3). Let 3 be a given family of tests, randomized 
or not. Since a randomized test ¢, such that ¢,(x,) = 0 or 1 for all x, is equiva- 
lent to a nonrandomized test w, , we may denote the tests in 3 by ¢, . Let 5, be 
the family of all tests in 3 which are based on n observations. Denote by 3;, the 
family of all tests ¢, in 3, for which 


(3.1) Eu |G.) 21 — m for all G, in Cin. 
THEOREM 3.1. Let 


M (¢,) _ SUPGneCon E(¢in | Ga), M, = inf, e310 M(¢,). 


If N(3, {@in}, {Con}, a1 , a2) ts finite, it is the least integer n for which M, S on 
and either M, < as, or M,, = a2 and M(¢,) = az for some ¢, in Tin. 

The proof is left to the reader. 

Due to the symmetry of the problem, the r@les of €, and 2, obviously can be 
interchanged. 

Adapting a familiar terminology, we may say that a test which satisfies (3.1) 
has level a; with respect to C;, , and we may call 1 — M@,) the minimum power 
of test o, with respect to C2, . If there exists a test ¢, in d;, such that M(@,) = M,, 
the test is said to maximize the minimum power with respect to C2, . Tests which 
maximize the minimum power can sometimes be obtained by a method due to 


Wald and explicitly applied to this problem by Lehmann ((3], Theorem 8.3). A 
proof of a special case of the theorem and illustrations of its use are given by 
Lehmann and Stein [4], [5]. Lehmann’s theorem immediately applies to cases 
where 3,, is the family of all tests ¢, , or of all tests ¢, which depend on a given 
function of x, . It can be extended to arbitrary families of tests. 


4. Asymptotic efficiency. The rest of this paper considers the asymptotic 
behavior of the efficiency index N(3) for certain families of tests in cases where 
the “distance” between the classes @;, and Cs, is small. Let 6(G,) be a real- 
valued function defined for all G, in @, and for every (or every sufficiently large) 
positive integer n. We assume that the set w of values 6(G,) when G, ¢ @, is an 
interval, finite or infinite, which is independent of n. Let @, and @ be two num- 
bers in w, with 6, < 6, and let @;, and G2, be the classes of all G, in C, such 
that 6(G,) S 6, and 6(G,) = 4 , respectively. 

Let {t,(x,)} for n = 1, 2, --- , be a given sequence of functions. Let 3 be the 
family of all tests ¢6° with 


1 if tn(x,) < ¢; 
(4.1) ¢$2(x,) = arbitrary if t,(x,) = ¢; 
0 if ta(Xn) C3 
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For definiteness, we shall assume that ¢{2 = 1 if t, = c, so that 3 is the family 
of nonrandomized tests w” with 
(4.2) Win = {xn: tn(Xn) S ch}, —-ox <c< mw; n =1,2,-:-. 
The asymptotic results to be derived for family (4.2) will also hold for any family 
(4.1). 

Nothing will be changed if 3 consists of all tests (4.1) with n exceeding a fixed 


number n’. In this case the words “for every n’’ in the following assumptions 
should be read ‘“‘for every n > n’.”’ 


We shall study the asymptotic behavior of N(3) = N(3, {Cin}, {Cen}, ar, a) 
when a , a: and 6; are held fixed and 6 = 6. — 4 tends to zero. 

Assumption A. The functions ¢,(x,) are independent of 6. 

Let 


Mi,(z, 0) = infoce,) <o.¢,cc, P(tn S Z| Ga), 
Mon(x, 0) = supece,)>6.¢,ec, P(tn S x | Gn). 
The functions M ;,,(z, @) are nonincreasing in 6. Hence the conditions 
P(X, € win | Ga) 2 1 — for all G, € Cin, 
are satisfied by test (4.2) if and only if 
M,,(c, 1) 21 — am, M2,(c, 0: + 6) S a. 


AssumpTION B. For every n, lim... Min(z, 6:1) > 1 — m. 
Let c, be the least number which satisfies the inequalities 


(4.3) Mn(Cn+, 6) = 1 ae = Min(Cr—, 6:), 


where c,,+ and Ca— are, respectively, the right and left limits. This number exists 
by Assumption B. In Theorem 3.1, we have M, = Mon(cn+, 6: + 5). Hence if 
N = N(5) is finite and greater than 1, 


(4.4) Mow(ew+, 1 + 6) S a2 S Me,w-a(ey-it, 6: + 4). 


ASSUMPTION C. a1 + a2 < 1. 

AssumPTION D. One of the following conditions is satisfied. 

(a) For every n and every z, M2,(xz, 6) is continuous on the right in @ at 
6 = 6; e 

(b) For every n and every 6 ew there exists a cdf Gy, eC, such that 
6(Gen) = 6’, and for every z, pn(z, 0) = P(t, S x| Gon) is continuous on the 

Lemma 4.1. If Assumptions A, B, C, and D are satisfied, N(3) ~ ~ asi— 0. 


Proor. First suppose that part (a) of Assumption D is satisfied. Then for n 
fixed and 6 > 0, 


Mon(Cn+, A, + 5) -? Men(Cnt, 6). 
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Since M,,(x, 0) S Mon(zx, 6), we have, by (4.3) and Assumption C, 
Mon(Cn+, 6;) = M;,(c+, 6;) = 1—- a > a. 


Hence N(3) will be larger than any fixed n as 6 — 0. 
Now suppose that part (b) of Assumption D is satisfied. Then 


Mon(Cn+, A, + 6) = Pn(Cn; A; + 5), PnlCn ’ 6;) = Minl(Cat, 6;) é 1 — a > ae. 


Since pa(cn , 0: + 5) — Palen , 0:) as 6 — 0, we arrive at the same conclusion. 

AssumpTIon E. There exist a sequence {h,(x)} of nondecreasing, continuous 
functions, a positive number r, and functions H;(x) and H,(z, d), defined for 
every d > 0, such that 


(4.5) Minlha(z), 6:) aod H(z), 
(4.6) Mon(ha(zx), oN + dn) 7 H,(z, d) 


as n — ©, for every x which is a point of continuity of H;(x) and H(z, d), 
respectively, and every d > 0. 

Note that H,(z, d) is necessarily nonincreasing in d, while H;(x) and H,(z, d) 
are nondecreasing in 2. 

AssumpTION F. (i) The equation H;(x) = 1 — a has a unique root rt = a 
at which H,(x) is continuous. 

(ii) The equation H,(a, d) = a, has a unique positive root d = D(a , a2). The 
function H.(z, d) is continuous at x = a for all d in a neighborhood of D(a; , a2). 

Assumptions E and F have the following meaning. The function M;,(z, 0) is 
a bound of edfs of t, . The function M jn(ha(x), 0) is the corresponding bound of 
the cdfs of t, = fa(tn), where f, = hz’, the inverse of h, . The function f, is 
strictly increasing. The tests with w;, determined by t,, S ¢ are equivalent to the 
tests (4.2). Thus Assumptions E and F require, roughly speaking, that a suitable 
function of t, have a limiting distribution which satisfies certain regularity 
conditions. 

TuHEroreM 4.1. Let 3 be a family of tests of the form (4.1), or the subfamily with 
c = C, fixed in such a way that h;'(c,) + aasn— ©. If Assumptions A through 
F are satisfied, then asymptotically as 6 — 0, 


(4.7) N(3) ~ {8"*D(an, o)}"”. 


Proor. We first assume that family 3 is defined by (4.2). By the remark fol- 
lowing Assumption F we may assume that h,(z) = x. Then relations (4.5) and 
(4.6) are replaced by 


(4.8) M;,(x, 6:) — H(z), 
(4.9) Mo,(x, 0: + dn’) — H,(z, d). 


From (4.3), (4.8) and Assumption F(i) it follows that c, ~ aasn— o, 
We now show that N = WN(3) is finite for every 6 > O, that is, 
Mon(Cn+, 6: + 5) S a for some n. By Assumption F we can choose d > D = 
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D(a , a) so that H2(z, d) is continuous at x = a. For every 6 > 0 and n so 
large that 5 > dn we have 


Men(Cnt+, 0 + 5) S Man(Cn+, 61 + dn). 


By Assumptions E and F, the right side tends to H,(a, d) as n — ~, and 
H,{a, d) < az: by Assumption F. Hence N is finite. 
We have to show that 


(4.10) iN’ D as 6-0. 


Suppose this is not true. Then there exists a sequence {6,} of positive numbers 
such that 6, — 0 and 6,.Ni — D’  Dask— o~, where0 S D’ S +o and 
N, is the value of N for 6 = 6, . By (4.4) we have for every k 


(4.11) Mon, (en, +, + dx) S a. S Mz, w,—-1(Cn,-1+; 6, + &). 


First assume D’ < D. By Assumption F(ii) there exists a number D” such 
that D’ < D” < D and H,(z, D”) is continuous at z = a. For k sufficiently 
jarge we have 5,Ni < D” and hence 


(4.12) Mon, (en,+; A; + dx) = Mon, (en, +; 6; ~_ D’'N;'). 
As k > o, we have (by Lemma4.l1) N,— © and cy, — a. Hence 
(4.13) Moy, (ew,+, 9: + D’’Ni") > H2(a, D”’) > om. 


But relations (4.12) and (4.13) contradict (4.11). Hence D’ = D. 

If we assume D’ > D, a similar argument starting with the right member of 
(4.11) leads again to a contradiction. This completes the proof for family (4.2). 

An inspection of the proof shows that (4.7) also holds for any family (4.1) 
and the subfamily with c = c, fixed, as stated in the theorem. 

We observe that the argument will not be essentially affected if the factor 
n~ in (4.6) is replaced by an arbitrary decreasing function k(n) which tends to 
zero asn — ©. Then N(3) ~ k“(8/D). 

Let {tin} and {t,} be two sequences of statistics, and denote by 3; and 3, the 
corresponding families of tests of the form (4.1). Suppose that Assumptions A 
through F are satisfied by both families. If r; and D(a: , a2), fori = 1, 2, denote 
the values of r and D(a; , az) for the two families, an application of Theorem 
4.1 gives immediately 

THeoreM 4.2. Let 3; and 32 be two families of tests of the form (4.1) which both 
satisfy Assumptions A through F. Then as 6 — 0, 


N(32) Do, a)/"? (re—r)/rire 
eff (31/32) NG) Dion, a2)" ay) Uri 6 ° 


Thus if r; < rz, the efficiency of family 3; relative to family 3. tends to zero. 
lfm, =r. = 1, 


limmgso eff (51/32) = (Dolor, a2) / Dilan , a))”, 
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Consider now the particular case where the distribution of t, depends on 
G, only through @(G,). We shall write P(t, < x | 6) for P(t,(X,) S x | G,) when 
6(G,.) = 9. In addition we shall assume that the power P(t, > c| @) does not 
decrease as @ increases; a ‘‘reasonable” test can be expected to have this property. 

AssumpTION B’. The distribution of t,(X,) depends on G, only through 6(G,), 
and P(t, < 2 | @) is a nonincreasing function of 8. 

If Assumption B’ is satisfied, we have M,,(x, 0) = M2,(z, 0) = P(t, S x| 6). 
Assumption B is then satisfied for every a, > 0. Assumption D is implied by 
Assumption D’. Forevery z, P(t, < x | @) is continuous on the right in 6 at 6 = 6;. 

In Assumptions E and F we have Hi(x) = H,(z, 0). If we let H(z, d) = 
H,(z, d), then D(a; , a2) is the unique positive root of the equation H~ (a: , D) = 
H™(1 — a, ,0). Theorems 4.1 and 4.2 hold with Assumptions B and D replaced 
by B’ and D’. 

In many applications the statistic ¢, or a function of ¢, will be asymptotically 
normally distributed. Let 


(4.14) (x) = (Qn)? [ oF? dy, 


AssumPTION E’. There exist a sequence {g,(t)} of everywhere increasing func- 
tions, a positive number r, and two functions u(@) and o(@) defined for 6 ¢ w, 
such that 


(4.15) Pn Qn(tn) — wl. + dn”) — 


ats 8 | Oe } ain 
as n — ©, for every x and every d 2 0. 
AssumpTION F’. The function (6) has at @ = 6, a right derivative yu’(@,) > 0. 
The function o(@) is positive and continuous on the right at @ = 6, . 
By Assumption F’ we can write 


u(O, + dn”) = w(O:) + dn“y'(:)(1 + en), = (01 + dn”) = o(f)(1 + €,), 
where ¢, — 0 and e, > 0asn— o. Hence 


rGn(tn) — (Ori + dn”) _ + gn(tn) — (Or) 


u’(@,)(1 + én) 


oGi+dn*) obi) +es) ol +e) 


has the same limiting distribution as 


+ Gnitn) — u(r), w’() 
may ee 


Thus if we replace z in (4.15) by  — dy’(@;) / o(@:), we obtain 
Onltn) — (6s) | 7 ( bs H) 
P{n Sea oD ~ ¥ | :+dn'>—-@(2 q 6) ; 


Assumption E is now satisfied with H,(z) = (zx) and H,(z, d) = 
(x — dy’(0) / o(6:)). 
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Let A(u) be defined by 


(4.16) u = 1 — O(A(u)) = &(—A(u)). 
Then Assumption F is satisfied with 


_ (0) 
D(a, a) = O,) fA(ar) + A(az)}. 


Hence we can state 

THEOREM 4.3. Let 3 be a family of tests of the form (4.1) or the subfamily with 
c = Cy fixed in such a way that n"o(6:)“[gn(cn) — u(0:)] > A(a1). If Assumptions 
A, B’, C, D’, E’, F’ are satisfied, then asymptotically as 6 — 0, 


oe a (a) (Mart seo)". 


If 3, and 3, are two families of tests which both satisfy the conditions of 
Theorem 4.3 with the same number r, we have 


(8) met (/5) = (553) / (Say) » 


where y;(6;) and o;(6;) are the values of u’(@;) and o(6,) for family 3; . 

Thus in this case the asymptotic relative efficiency is independent of a; and a . 

Relation (4.18) is essentially due to Pitman, who obtained an analogous 
result (for r = 4) under somewhat different assumptions. Pitman’s result was 
extended by Noether [7]. 

Assumption A (t, independent of 5) is somewhat restrictive. Thus if C, is a 
class of distributions depending only on the parameter 6, the most powerful test 
for testing the hypothesis @ = 6, against the alternative 6 = 6, + 6 will in general 
depend on 6. If Assumption A is dropped, M;,(x, @) and c, will depend on 6. 
Theorem 4.1 can be extended to this case by suitably modifying the assumptions. 
We shall state a corresponding theorem for the special case where the distribu- 
tion of ¢, depends only on 6(G,) (and on 6 through ¢,), and a function of ¢, has 
a normal limiting distribution. 

To emphasize the dependence on 6 we shall write ¢;, for ¢, and c,(6) for c, . 
Let Assumption B’ be satisfied. 

Assumption D”. For every n, 


(4.19) P(tsn S z| 0+ 5) — Pltn S x| 0) > 0 
as 6 — 0, uniformly in z. 
Lemma 4.2. If Assumptions B’, C, and D” are satisfied, N(3) —~ ~ asi — 0. 
Proor. After substituting c,(5) for x in (4.19), the proof parallels that of 
Lemma 4.1. 
Assumption E”’. There exist functions g,(t, 5), defined for 5 > O andn = 1, 
2, --- , which are strictly increasing in ¢; two positive numbers r and 6, ; and 
two functions u(@, 5) and o(@, 5) defined for 6 ¢ w and 6 > 0, all such that 


r On(tsn, 5) a u(8, 5) 
Pn a < ae < x |} > #2) 
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as n — for every z, uniformly for 6; S @ < 6: + 6, and0 <6 < . 
Assumption F”. The limit 


u'(6,0) = lim “0% + 4 8) — u(6r, 6) 


0<5-+0 6 


exists and is positive. Also, o(8, 5) is positive and continuous on the right at 
(6, , 0), that is, o(@, 5) + o(6,, 0) > 0 as 6 > 6, and 6 — 0, with 6 = 6, and 
5> 0. 

THEOREM 4.4. Let 3 be a family of tests of the form (4.1) or the subfamily with 
c = c,(6). If Assumptions B’, C, D”, E”, F” are satisfied, then asymptotically as 


5 0, 
ve) ~(Speg) Ceeexe)”, 


Proor. Assumption E” implies 


n’ gn(en(5), 5) = u(G1, ) 


o(0:, 8) —> Men) 


as n — ©, uniformly for 0 < 6 < 6,. The rest of the proof is similar to the 
proofs of Theorems 4.1 and 4.3. 


5. Illustrations. Three examples are offered. 

EXAMPLE 1. A test for regression. Let G, be the cdf of n independent, normally 
distributed random variables with common variance o° and means EX; = j¢ for 
j=1,---,n. Let 0 = 0(G,) = £/o, with 6; = 0 and 6 = 6. Let 


tit tn ita RN ns wep giant 
VP -— (Lin) Vo - vs 
where yn = )0jz;/ ~/>>;* and all summations are from 1 to n. Here y, is 
normally distributed with mean £+/}*;* and variance o. Also, 
J/ (Sox? — y2)/n tends to « in probability. Hence ~/nt, is asymptotically 
normal (6 V7}; 1). Observing that }-j’ ~ n*/3, it is easy to verify that the 
conditions of Theorem 4.3 are satisfied with 


g(t) = V3t/n, r=3/2, pw(@)= 6, o(6) = V3. 


N w~ 3% ( + nen)" 
mes 


EXAMPLE 2. A one-sided test of fit. Let 6(F) = sup_scecu {Fo(x) — F(z)}, 
where F(z) is a fixed continuous cdf. Let F(x) belong to the class € consisting 
of Fy and all continuous cdfs F with 0(F) > 0. Let F,(x) be the empirical cdf 
of a random sample of n observations from F, and let t, = +/n@(F,). For deciding 
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whether F = F, or 6(F) > 0, consider a test which accepts the former alternative 
when #, < c. Smirnov has shown (see, e.g., Feller [2]) that asn — o, 

P(t, < 2| Fo) 71 - ". z> 0. 


Birnbaum [1] obtained the best upper and lower bounds for the power of the 
test in the class of continuous cdfs with 6(F) fixed. From Birnbaum’s Theorem 1 
we have for 0 < z < 6 V/n, 


superas P(t, < x| F) = supsse<: Qn(n 2, 6, v), 
where 
Q,(e, 6, v) = pe (") (v— sl —v +8)", 7 = [nv — o). 
imj+1 \2? 


For z = 8~/n, supegy_s P(t, < x| F) = 1. 
The function Q,(e, 5, v) is decreasing in 5. Hence if § < 4’, 


SUPsse<1 Qale, 5, v) S SUPs <og1 Qale, 6, v) S supa sexi Qnle, 8’, v). 
Thus for 0 < x < 6 V/n, 
M2,(z, 8) = supew)>s P(t, < x | F) = supsses: Qa(n™ 2, 5, v). 
Forz £0, M2,(z,6) = 0. Forz = 6~/n, Maz, 8) = 1. 
If v is fixed, 0 < v < 1, we have forn > ~, 


1/2 1/2 a d_ 
Q,(n x, n d, v) <= h (=): 
Using this result it can be shown that asn — ~, 
M2,(2, nd) + (22 — 2d), 0<2<d. 


It can now be verified that the conditions of Theorem 4.1 are satisfied with 
ha(z) = x and 


0, zs0, 


0, 
H,(z) = pe H(z, d) = (@(22 — 2d), O< x<d, 
iI—¢”, > Od; ; sa 
; z2d. 


zs0 


That Assumption D(b) is satisfied can be seen from Birnbaum’s Theorem 1 
and the fact that Q,(e, 8, v) is continuous in 6. Thus if a; + a2 < 1 and a: < 3, 


N(3) ~ a44/ 4 log = + Ma} 


EXAMPLE 3. The double-exponential distribution and the sign test. Let x, have 
the probability density 2” exp (— > 7-1 |x; — 6|). The most powerful test for 
testing 6 = O against 6 = 5 > O accepts @ = O for small values of 
tin = > juni a(x; , 5), where a(x, 5) = ( |x| — |x — 4|) / 6. Since a(z, 8) is a non- 
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decreasing function of z, it is easily seen that P(4, < c| @) is a nonincreasing 
function of @. 


Asn— ©, t, is asymptotically normal (nu(@, 5), no°(6, 8)), where 
—1+ (e — )/, 
u(@, 8) = 4 (20 — 8)/6 + (e* — e*)/6, 
1+ (e° — ¢°")/a, 
o°(0, 8) = u2(6, 8) — u(6, 6)°; 
1+ {(4 — 26)e’ — (4 + 28)e"*} /8*, 6<0, 
ur(0, 8) = {8 + 46 — 48)"}/8 — (44 wer +e )/*, OS 054, 
1+ {(4 — 26)e** — (4 + 26)e*} /8", 5 
It can be verified that the conditions of Theorem 4.4 are satisfied with 
ga(t, 5) = t/n, r = 4, p’(0, 0) = 1, and o(0, 0) = 1. That the uniformity 
condition in Assumption E” is satisfied can be seen from the fact that 
E{ \a(X, 5) — »(@, 8)|* | 6} / (0, 8)* is bounded (since a(z, 4) is bounded); this 


implies uniform convergence by Liapunov’s or Berry’s bounds for the remainder 
term in the central limit theorem. 


Thus if 3; denotes the family of the most powerful tests based on t;, , we have 
N(3s) ~ 8 *[A(ax) + A(on)]. 
Asi— 0, t, tends to &, = 2m — n, where m is the number of positive 


values z;, forj = 1, --- , n. The family % of the tests based on tH, (sign tests) 
has asymptotically the same efficiency index (up to order 5’), so that the sign 
test has asymptotic efficiency 1 for the present problem. This is not surprising 
in the light of a recent result of Ruist [8], who showed that the sign test is most 
powerful for discriminating between two symmetrical continuous distributions 
which can be regarded as approximations of double-exponential distributions. 
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ON A THEOREM OF PITMAN 
By Gortrriep E. NorrHer 
Boston University 


Summary. A theorem by Pitman on the asymptotic relative efficiency of two 
tests is extended and some of its properties are discussed. 


1. Introduction. The idea of the relative efficiency of one estimate with re- 
spect to another estimate of the same parameter is well established. This can- 
not be said, however, of the corresponding concept for two tests of the same 
statistical hypothesis. This paper is concerned with a definition of the relative 
efficiency of two tests which seems to be due to Pitman (see, e.g., [1] p. 241) 
and has been used in several recent papers. 

Derrntrion. Given two tests of the same size of the same statistical hypothesis, 
the relative efficiency of the second test with respect to the first is given by the 
ratio n:/n2 , where nz is the sample size of the second test required to achieve 
the same power for a given alternative as is achieved by the first test with 
respect to the same alternative when using a sample of size n; . 

In general the ratio n:/n2 will depend on the particular alternative chosen 
(as well as on n,). However, in the asymptotic case, this somewhat undesirable 
fact can be avoided. It might be argued that restriction to the asymptotic case 
is even more undesirable in itself, but the unfortunate fact remains that for 
many test procedures in current use the asymptotic power function is the only 
one available. 

Now, at least for consistent tests, the power with respect to a fixed alternative 
is practically 1 if the number of observations is sufficiently large. Therefore, the 
power no longer provides a worthwhile criterion for preferring one test over 
another. On the other hand, it is possible to define sequences of alternatives 
changing with n in such a way that as n — © the power of the corresponding 
sequence of tests converges to some number less than 1. It seems then reasonable 
to define the asymptotic relative efficiency of the second test procedure with 
respect to the first test procedure as the limit of the corresponding ratios m:/n . 

A theorem due to Pitman allows us to compute this limit if certain general 
conditions are satisfied [1]. The purpose of this paper is to give an extension of 
Pitman’s theorem and to discuss some of its properties. The derivation of the 
present version of the theorem follows Pitman’s original method of proof. Since 
this proof has not appeared in print, full details are given. 


2. Asymptotic power. Assume that we want to test the null hypothesis Ho: 
6 = 6 against alternatives H: 6 > 4. As mentioned in the Introduction, we 
shall assume actually that a particular alternative @ = @, changes with the sample 
size n in such a way that lim,.. 0, = %. 
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To be more definite, let the test be based on the static T, = T(x, --+ , tn). 
Let’ ET, = y,(6) and var T, = a,,(0). Assume that 


A. Vin(Oo) = --» = Wr" (0) = 0, yh" (@) > 0, 
B. limnen 2 Wo” (0) / on(O) = c > 0 for some é > 0. 


The indicated derivatives are assumed to exist. We shall consider the power of 
the test based on 7’, with respect to the alternative Hi: @, = 0 + k/n’, where 
k is an arbitrary positive constant. In addition to A and B we shall assume 


C. Miieae v” (0n) / vi” (60) = Re LIM noc on(0,)  Fn( Oo) - 1, 


D. the distribution of [7', — Wn(8)] / on(@) tends to the normal distribution with 
mean 0 and variance 1, uniformly in @, with % < @ S 6 + dforsomed > 0. 


Let $(\) = [ exp (—32°) dz / /2e and find 2». euch that 60.) = «. 


For sufficiently large n, a critical region of approximate size a is given by 


Tr 2 Tala),  [T'nle) — Wn(40)] / on(O0) = ra 
The power of this test with respect to the alternative H, is given by 
Ln(9n) = P{Tn 2 Ta(a@) | On} ~ O(tn), 
where t, = [on(90)Aa + Wn(40) — WalOn)] / on(On). Now 
Yn(On) = Wn(Oo + k/n*) = Yn(Go) + (1/m!)(k/n')"¥s" (6), bo <8 < 4, 


and 


bx Tal Oa)da — (A/min k/n YO) WSC) _, 4 __ Re 


[on(On)/on (00) on (G0) —— m!\ ° 
Thus asymptotically, Ln(0,) ~ (Aq — k”c/m!). 
It follows from the proof that condition (D) can be replaced by the some- 
what weaker condition 
D’. the distribution of [T, — Wa(@.)] / o(@,) tends to the normal distribution 
with mean 0 and variance 1, both under the alternative hypothesis H, and under 
the null hypothesis 0, = 4%. 
It is also clear that alternatives of the type 0, < % or |6,| ~ %, or the case 
when yS”” (@) < 0, can be handled correspondingly. 
Let y > 6 and consider the alternative H,: 6, = % + k/n’” analternative 
which converges to 6 faster than H, . Now 
m (m) m (m) 
ene ee 


no min On(4) ne m| norm n>™on (60) 14 re : 


1J. Putter [4] has pointed out that the functions y,(6) and a’, (6) need not necessarily 
be the mean and variance of T,, respectively, as long as conditions A, B, C, and D or D’ 
are satisfied. 
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and the power of our test with respect to this alternative H, is equal to the size 
of the critical region. The test cannot distinguish between H) and H, . Similarly, 
if y < 4, the power of our test converges to 1. 


3. Asymptotic relative efficiency of two tests. Assume now that we have two 
tests based on the statistics T,, and T2, . Assume further that 6; > 6, and con- 
sider the alternative H;: 6, = 0 + k/n*' . It follows from our previous results 
that the second test is ineffective with respect to this alternative, while the power 
of the first test can be made as large as we please by choosing k sufficiently large. 
Therefore, the asymptotic relative efficiency of the second test with respect to 
the first test is zero. 

Thus, from now on, we assume that 6; = & = 6. 

According to our definition of relative efficiency, the two tests must have 
identical power with respect to identical alternatives. The two tests have identi- 
cal power if 


(1) kT ey /m,! = k3? c2/me! 
The alternatives are identical if 


(2) ky in’ as ke/ni ° 


If now m, = m, = m, asit must beif m;5 = 4 forz = 1 and 2, which is true in 
most cases, we can proceed as follows. From (1) and (2) we have 


a(R) = (9) = ee Al » eM 


Ne 


ke 


Cy 


= lim <-/"/¥2 we oo Eee «= Be 
nave (1/n)[k™(O0) / o1n(B0) |" nan RRIE5(B) " 


where 


(3) Rin(O) = in?(8) / oin(8), j= 1,2. 


1/mé 


Pitman has called the quantity R;,""(4) the efficacy of the ith test in testing 
the hypothesis Hy : 6 = % . Thus we get 

PirMan’s THEOREM. The asymptotic relative efficiency of two tests satisfying 
A, B, C, and D or D’, with 6; = 6. and m, = mz, is given by the limit of the ratio 
of the efficacies of the two tests. 

For m = 1 and é = }, this theorem reduces to the one quoted in [1]. If mé = 3, 


(4) Ey = lim, +20 Rin(60) / Rin(60). 
If, in addition, 


(5) limy 0 V4" (90) / w{n() = 1, 


then (4) reduces to Ea = lity +x cin/o2n - 

This is the usual expression for measuring the asymptotic relative efficiency of 
two estimates of the same parameter. Thus, only if (5) is satisfied can we use 
the ratio of the variances of the two test statistics as a measure of the asymptotic 
relative efficiency of the two tests. In particular, if T;, and T2, are unbiased 
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estimates of the parameter 6, (5) is satisfied with m = 1, and Ey is the same as 
the asymptotic relative efficiency of T, and T; used as estimators of 0. 


4. Comparison with another definition of relative efficiency. Another defini- 
tion of the relative efficiency of two tests in current use (see, e.g., [2] p. 597) is 
based on the ratio of the respective sample sizes under the assumption that the 
power functions of the two tests have equal slope at 6 = @. 

We shall show that if m = 1 and 6 = 3, the two definitions give the same 
value for the asymptotic relative efficiency, provided a very general condition is 
satisfied. 


Under the conditions of Pitman’s theorem we have, as before, L,.(@) ~ $(t,) 
where 


i, = [Aaa n( A) + Wn( Oo) ai ¥n(4)] / (6). 


If L’,(8) converges uniformly to some limit, this limit must be d¢(t,)/d@. Actually, 
the exact form of L’,(@) will rarely be known, so that the uniform convergence 
cannot be investigated. However, even ix this case it is customary to replace 
L’.(8) by do(t,)/d@ in computing the ratio of the slopes of the two power func- 
tions. Thus it seems reasonable to compare the asymptotic relative efficiency 
based on the slopes d¢(t,)/d@ with Ex . Now 


do(tn)| 
dé ." aE™ rr Se 


6=69 


Vn (Bo) On of) 1 


; 2 1/2 
= Van OP aa (60) + ra 74(0) an oP (—$r.)en'”, 


provided o,()/on(%) = 0(+/n), which is very generally true. The requirement 
that the two power functions have equal slope at the point 6 = @ becomes 
avn = Vn, so that the asymptotic relative efficiency according to this 
definition is again given by 


(ni/ne) = (2/1)? = En. 


5. Efficacy of a test. Still assuming that m = 1 and 6 = }, it is interesting 
to investigate more closely the efficacy R%, , where R,, is given by (3). Consider 
the function t = y,(u) determined by E T, = y,(0). Unless y,(0) = 6, T,, is not 
an unbiased estimate of 6, but may be considered an unbiased estimate of the 
ficticious parameter 7 = y,(6). 


Let u = ¢,(t) be the inverse of t = y,(u) and define the statistic U, = ¢,(T,). 
Then we may write 


Un — 8 = on(Tn) — ont) = (Ta — 7) on(r) + °° 


If it is permissible to neglect terms of higher order in T,, — 7, we find E U, ~ @ 
and 


var Un ~ [en(r)]’on(0) = 0.(8) / [Wn(0)]? = Ro?(8). 
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Thus, if the above conditions are satisfied, asymptotically the efficacy of T, 
is the reciprocal of the variance of an asymptotically unbiased estimate’ of 6 
based on 7’, . 


Now, under the regularity conditions for the Cramér-Rao inequality, 
var U,, = 1/nE(@ log f/6)*. Therefore 


Ri(0) S nE(@ log f/a6)’. 


Thus we may use the quantity R%,(0) / nE(a log f/a0)” as a measure of the 
asymptotic efficiency of the test based on the statistic T,, . 
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AN EXTENSION OF WALD’S THEORY OF STATISTICAL 
DECISION FUNCTIONS' 


By L. LeCam 
University of California, Berkeley 

1. Introduction. The material of the present paper was developed, during the 
spring of 1953, primarily to meet pedagogical needs. It is similar to the contents 
of Chapters 2 and 3 of Wald’s book [1]. The results are an extension of Wald’s 
theory in the sense that some requirements of boundedness or even finiteness of 
the loss function are removed. Moreover, Wald’s requirements of equicon- 
tinuity are replaced by a requirement of lower semicontinuity of the loss func- 
tion. 

In the first part of the paper it is shown that, under suitable assumptions, the 
set. D of all decision functions can be identified with a convex subset of a certain 
topological vector space. If further assumptions are made on the loss function, the 
risk functions become lower semicontinuous linear functions defined on D. It 
is then easy to give conditions under which D, or some subset D of D, is compact. 

The next section is devoted to proofs that convexity and compactness of the 
space of decision functions, together with lower semicontinuity of the risk 
functions, imply completeness of the intersection of the class of Bayes’ solutions 
in the wide sense with the closure of the class of Bayes’ solutions. 

The methods of proof differ very little from the methods used by Wald [1], 
though it has been necessary to use slightly more general topological methods, 
for instance, to prove compactness instead of sequential compactness. Although 
it might be possible to extend the proofs given by Wald [1] or Karlin [2], [3] to 
the case considered here, it is on the whole simpler and shorter to start from the 
basic elementary lemmas. 


2. Assumptions on the decision problem. In this section weakened forms of 
Assumptions 3.1 to3.6 of [1] are stated. Let X = {X,} fori = 1, 2, --- bea set 
of random elements, not necessarily real or even vector valued. Let 9 be the space 
of values of X and let 2 be an arbitrary set of indices. We will suppose that there 
is given on X a o-field @ with respect to which all the X,’s are measurable, and 
that to each w ¢ 2 corresponds a probability distribution on @. 

If the variables X;,, X;,, --- , X4 are observed in this order, we will say that 
h = {t, t, --+, %&} is observed and restrict the notation \ to ordered sets of 
indices which can be observed in the order given by \, the first variable observed 
being X,, , the second X;,, and so on. The variables {X;,, --- , X;,} determine 
on X a smallest o-field @, C @ with respect to which they are measurable. For 
all practical purposes it is equivalent to say that an @-measurable function f(z) 
is @,-measurable or that ‘it is a function of {X;,, --- , X4,} only. 


Received May 25, 1953, revised May 3, 1954. 
1 This paper was prepared with the partial support of the Office of Naval Research. 
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At a certain stage \ of experimentation (including the start), the statistician 
has to choose an element among a set of available actions. This set A, includes 
the available terminal decisions 7, as well as the decisions on how to continue 
experimentation, say J, . The set J, will be identified with the set of indices of 
variables which could be observed in the next step. We assume the following. 

ASSUMPTION 1. Whatever may be X, the set J is finite. 

This condition implies that the set of variables which can be observed in not 
more than n steps is finite. Let A, be the corresponding set of \’s and let A = 
U,A, . Let @, be the smallest o-field containing all the @, ford ¢ A, . To simplify 
further formulas, we denote by P? and P* the contractions of P. to @, and 
Q, , respectively. 

ASSUMPTION 2. For every n there exists on @, a o-finite measure yu, such that, 
whatever may be w ¢ ©, the probability measure P% is absolutely continuous with 
respect to up . 

Assumption 2 will be the only restriction placed upon the strategies of nature. 
It is implied by (3.1) or (3.2) of [1], but is strictly weaker than either (3.1) or 
(3.2). Discussion of Assumption 2 is deferred until after the statement of As- 
sumption 6. 

AssuMPTION 3. For every \ ¢ A, the terminal space 7, is a metrisable space, 
locally compact and the union of a denumerable family of compact spaces. 

The space A, will be considered as topological sum of 7, and ./, , this last set 
being supplied with a discrete topology. 

If 6 is a certain decision function, for a given n, a given \ ¢ A,, and anz eX, 
we can consider the probability that \ be observed and that the next decision 
belongs to a specified subset S of A, . This defines a measure denoted below by 
g(a, x, 6) on a o-field of subsets of A, . It will always be assumed that this o-field 
is the o-field of Borel subsets of A, . If u is a numerical function defined on A, , 
its integral with respect to the measure ¢(A, x, 5) will be denoted by ¢(A, x, d)ou. 

Thus if u is the indicator of a Borel set D‘ C 7) , then (A, x, 5)ou corresponds 
exactly to the p(di , di, --- , dt , D‘ | 2, 8) defined in Formula (1.3) of [1]. In the 
present notation, \ replaces the ordered set of d{ and u replaces D‘. It will be 
convenient to denote by a, the function identically equal to unity on 7 and zero 
on J, , and by by the function identically equal to unity on A, = 7, U J, . Fur- 
thermore, let K, denote the linear space of bounded continuous functions defined 
on A, and vanishing outside a compact subset of A) . 

AssuMPTION 4. Whatever \ ¢ A and whatever u ¢ K, , the integral g(A, x, d)ou 
is an @,-measurable function of z. 

The purpose of this assumption is to give a meaning to integrals used below 
in the definition of a risk function. It also expresses the fact that g(A, x, 5) does 
not depend on variables which have not yet been observed. 

AssumpTION 5. The cost of observing \ is a nonnegative, @,-measurable func- 
tion C(A, xz, w). If X’ is an initial segment of \ then C(A’, z, w) S C(A, 2, w). More- 
over there exists a sequence C%(w) of nonnegative functions of w such that 
lim nce C%(w) = © and C%(w) S C(A, x, w) for every \ having at least n elements. 

AssumpTION 6. If the statistician does not reach a terminal decision in a finite 
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number of steps, he pays an infinite amount. If the statistician reaches a decision 
t in n steps by observing \ he pays a total amount 


C(A, 2, w) + Wa, t; A)A(A, 2, w), 
where C is the cost function defined above and W and h are extended numerical 


functions satisfying the following conditions: 
(i) inf W(w,t;A) > —@; 


AeA, teT 

(ii) A is a nonnegative @,-measurable function such that sup, A(A, x, w) S 1 
for every (A, w). 

(iii) For each (A, w), the function W is a lower semicontinuous function of t 
on T). 

Remark. It is possible to make W depend directly on x by introducing condi- 
tions of strong measurability. For instance W(w, t, \)h(A, x, w) could be replaced 
by Dees W j(w, t, A)h;(A, 2, w), with W; and h; nonnegative. 

Before entering further developments we will discuss Assumption 2 and intro- 
duce some simplifying notation. We notice first that in Assumption 2, u, could as 
well be taken finite instead of o-finite. Since u, will not enter by itself in the next 
section, this is irrelevant. The properties actually used in the proofs are much 
weaker, and Assumption 2 could be relaxed as indicated below. Assume that yu, 
has been chosen finite. For each \ ¢€ A, let £, be the space of equivalence classes 
of numerical functions defined on 9, measurable with respect to @, and yu, inte- 


grable. If the norm of f ¢ £ is defined by ||f|| = fis du, , then £, is a Banach 


space. The adjoint of £, is, according to (2), identical with the space of u,- 
equivalence classes of bounded @,-measurable functions on %. 

It is convenient to reduce the arbitrariness of 4, and £, , and take instead of 
£ the smallest L-space, say L, , containing the family {P%}. For the definition 
of this space and the properties used below, see [4] and [5]. Two @,-measurable 


functions ¢; and ¢g2 can be called P-equivalent if [ie — ¢2| dP’, = 0 for every 


w € 2. Assumption 2 could then be replaced by the considerably weaker assump- 
tion that, whatever may be \ « A, the space JZ, has for adjoint the space M) of 
P-equivalence classes of bounded @,-measurable functions. Thus such noncon- 
ventional families of distributions as the family of all discrete distributions on 
the interval [0, 1] could conceivably be introduced in the theory. 

Even under its restricted form, Assumption 2 is more general than, for instance, 
(3.1) of [1] since it does not place such a strong restriction on the dependence 
between successive observations. This allows the consideration of different groups 
of random variables as vector variables which might be very strongly related. 
Since the cost of observing a vector might very well be different from the total 
cost of observing the components separately, and since moreover some of the 
spaces 7, might be empty, the scheme considered here is at least as general as 
the scheme considered in [1]. 

The spaces I, and M), just defined will be used in the rest of the paper. Let 
Lx denote the positive cone of L,, and let L,(a) be the sphere I,(a) = 
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{f: \|f\| < a}. Furthermore, let Lx(a) be the common part of Lx and L,(a). 
Similar notations will be used for the spaces M, and K, previously mentioned. 


If s e M, and f ¢ Ly, let fos denote the integral fos = [o) df. Let IN, be the 


space of P-equivalence classes of @,-measurable finite or infinite numerical 
functions on &. 

Let S be a subset of 9M such that, if s; , s. ¢ S, then there exists s; ¢ S satis- 
fying s; = s, and s; 2 s.. Assume moreover that the elements of S are all larger 
than a given s) ¢ M, . The assumption that M) is the adjoint of Ly is known to be 
equivalent to the following: for each S with the precited properties, there exists 
an § ¢ 9, such that f ¢ Lx implies fos = sup,.s fos. If S ¢ M,(a), then § ¢ M,(a) 
and is uniquely determined. This § will be called the supremum of S and denoted 
by § = sup,es s = sup S. By convention if \ is the empty set we will take M, 
and JL, to be the real line. 

It will be necessary to distinguish between the equivalence classes belonging 
to M, and functions belonging to these equivalence classes. Thus, if s «eM, a 
function of the equivalence class of s will be denoted by § or by s(x). Similar no- 
tation will be used for M, and M, . 


3. Representation of decision functions by families of linear mappings. If 
Assumptions 1 to 6 are satisfied, as far as the value of the risk is concerned a 
decision function is adequately described if the measures ¢(A, x, 5) are given up 
to a P-equivalence. It will therefore be convenient to identify decision functions 
which differ only on P-null sets. For a given \ ¢ A the measures ¢(A, x, 5) define 
linear mappings from K, to M, . These linear mappings satisfy the following con- 
ditions (the subscript \ has been omitted for easier reading). 


(a) your + you, = go(u; + Ue), 

(b) goau = agou for every real a, 

(ce) |\gou|| S |}u\, 

(d) if ue K~, then gou eM”. 

For any element s ¢ M, let |s|} = sup(0, s) — inf(0, s) and for any mapping 


satisfying properties (a, b, c) let v», = sUPuexq |you|. It is easily seen that for 
a ¢ satisfying (a), (b), (c), and (d), we have 


Ye, = groby = sup ¢°U. 
ueKT (1) 


In these formulas the supremum is taken with the meaning as previously defined. 
Let Ay be the space of decisions available before experimentation starts. Let 
h = {u, ---, t%&} and (A, 7) = {i, ---, &, J} withj e J), and let u; be the 
indicator of j in A, . The decision procedures also satisfy: 
(e) gocAy 7 1, 


(f) —r°eUu; = ¢a.i0a.A ; 


Sy ath. dion an lel, Sele I u(t) dF (6), 
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where F, is for each x a probability distribution on A, . It is not difficult to see 
that every system of measures satisfying conditions (a) to (g) defines an essen- 
tially unique decision procedure. The only condition not directly expressible in 
terms of equivalence classes is condition (g). The purpose of this section is to 
show that under reasonable conditions it is automatically satisfied, and thus 
eliminate it. To this end consider the following system of mappings. For each 
n and each ) «€ A, let g be a mapping (not depending on n) from K, to M). 
Assume that each of the ¢’s is a normed linear mapping from K, to M) , that is, 
¢ satisfied (a), (b), and 


(c’) \goul| S m |lu|| for some m. 


Such a system will be denoted by y% , and the sequence {y%} forn = 0,1, --: 
by y*. The set of all ¥%’s will be denoted by V% and the set of y*’s by ¥*. A 
system y* in which the g’s satisfy (a) through (f) will be denoted by y, ; simi- 
larly for y and the corresponding capital letters. The proof that every y eV 
satisfies (g), so that it defines a decision function, is an immediate consequence 
of the following lemma. Let 9, L, , My and A, be as before, and for simplicity 
omit the subscript X. 

Lemma |. Let K be a vector lattice of numerical functions defined on a set A. Assume 
that 

(h) K is separable for the topology defined by the norm |\u|| = supsas |u(t)|, and 

(k) there exists a o-field @ on A such that every positive normed linear functional 


6 on K can be represented by @ou = ||6\| i u(t) dF(t), where F is a o-additive 
4 


probability distribution on (A, ®). 
Then every linear mapping ¢ from K to M satisfying (a), (b), (c), and (d) can 
be represented in an essentially unique manner by 


gou = v, equivalence class of | u(t) dF, (t), 
4 


where F, is for each x ¢ X a probability measure on (A, B). 

This lemma is a modified version of Theorem 3 of Doob [6]. (See also Gelfand 
[7], part 2, par. 7, Thm. 1.) If A is locally compact, metrisable, and denumerable 
at infinity, then the space K of continuous functions with compact nucleus satis- 
fies both (A) and (k). The separability of K is well known and (k) follows immedi- 
ately from the Riesz representation theorem. For other spaces to which the con- 
clusion of the lemma applies see [6] and the theory of the Daniell integral (for 
instance Saks [8], p. 328). 

Since conditions (a) to (f) are preserved under convex combinations, we have 

THEOREM 1. Under Assumptions 1 to 4, every system y © Y of mappings satis- 
fying (a) through (f) can be obtained in an essentially unique way by a decision 
procedure, and conversely. The space D of decision procedures satisfying Assump- 


tions 1, 3, and 4 can thus be identified with the convex subset V of the linear system 
v*. 
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Since W* is a linear space, it is possible to define on it a number of interesting 
topologies. One such topology 3 is defined below. Under the conditions (3.1)—(3.6) 
of [1] the tepology 3 coincides with the topology of regular convergence of [1]. 
Consider mappings ¢) satisfying (a), (b), and (c’). On the set of such mappings 
we can define a topology 3, by the generic neighborhoods 


Vin|d, u, f, €} = ter: [foprou — foyyou| < «, |fopoa — foprea| < ¢}, 


where u ranges through K, and f through J, , and « is a positive number. On 
W*, define the topology 3, by replacing g, by y* in the preceding formula and 
letting \ run through A, . For m < n consider the projection ¥% — IIn,.~% defined 
in the following way. If \ ¢ A,, , then tog correspondsg,. If \ = {i1, --+, im, 
dm+i, °**, tr}, Withm <r Sn, then tog corresponds yg, with \’ = {i , «++, im}. 

It is clear that II,,, = I1,,II,, form < v < n and that the projections I,,, 
are continuous for the topologies 3,, and 3, . Let 3 be the topology defined on ¥* 
as projective limit of the 3,’s with system of projection the II,,,,’s. (See, for in- 
stance, Lefschetz [9], p. 31.) For 5, the linear system ¥* becomes a locally convex, 
Hausdorff vector space. Moreover, conditions (a) through (f) are preserved by 
passages to the limit under 3; hence W is a closed convex subset of ¥*. 


4. Compactness of the space of decision functions and lower semicontinuity 
of the risk functions. This section gives a necessary and sufficient condition that 
a subset D of D be compact in the topology 3 defined above. The word compact 
is used in the sense that every covering by open sets has a finite subcovering, 
not in the sequential sense. The conditions for compactness of D result from 

Lemma 2. Let ) be fixed and let © be a family of mappings from K, to My which 
satisfy conditions (a) through (d). Let Assumptions 1 to 4 be satisfied. 

Then a necessary condition that ® be relatively compact for 3, is that, whatever 
f ¢ LX and whatever « > 0, there exists u(foe) e KX (1) such that 


folve — voulf, €)] S  |Ifli for every g €®. 


A sufficient condition is that the preceding condition holds for every f in a subfamily 
of {PS} generating the same L-space. 

Proor. If instead of the smallest L-space containing the {P%} we had taken 
another space £,, then in the statement of the lemma P’, would have to be re- 
placed by f ¢ £x(1). Lemma 2 is of the same general nature as the well known 
Helly compactness theorem. The proof sketched below differs from the usual 
proofs of Helly’s theorem in that the denumerable Helly selection principle has 
been replaced by the topological tool known variously as “ultrafilter” (({10), 
pp. 25, 59) or “universal net” [11]. The use of this tool is necessary to avoid sep- 
arability assumptions. 

The necessity of the condition is quite obvious. The proof of sufficiency follows. 
Let U be anultrafilter on (or a universal net of ¢’s). Then limy fogou = a(f, u) 
exists for every f ¢ L, and u ¢ K, . Conditions (a) through (d) are preserved when 
taking limits so that a(f, u) can be written foy°°u where ¢’ is a mapping having 





DECISION FUNCTIONS 75 


the properties (a) through (d). Moreover limy vy, = v 2 vyo. Foragivenf ¢ {P.} 
we have 


flv, — poulf, \]) << «, folv — grou(f, 6] <«. 


This implies fol[y — v,yo] S «, hence fol[y — v,o] = 0 for every f ¢ {P%}. Conse- 
quently go[y — v0] > 0 only if g has a nonzero part disjoint from every f ¢ {P}. 
But then g does not belong to the minimal L-space containing {P%}. This im- 
plies » = lime vy = vo = v(limg ¢) so that U converges to ¢’ for the topo- 
logy 3, . This leads us to the following 

Assumption 7. A set D of decision functions satifies Assumption 7 if, for each 
e > 0, each d € A, and each f ¢ {P}, there exists a u ¢ Ky satisfying 


(i)0 Susi and u(t) = 0 for ted, 
(ii) fop,(5)ou 2 foy,(S)om, — «, 


this last condition being fulfilled uniformly for every 6 ¢ D. 

According to Lemma 2, in order that a set D C D be compact for 5 it is neces- 
sary and sufficient that it be closed and satisfy Assumption 7. 

We can now obtain a relation between 3 and the risk function. Let \ be a 
particular element of A, and let v be a lower semicontinuous function defined on 
A, and such that »v = 0. If g is a mapping having the properties (a) through (d), 
it can be extended to a class of Baire functions by the Daniell-Bourbaki procedure 
giving 

gu = sup gu, 
ueKysusv 
the supremum being taken in the sense previously defined for measurable func- 


tions in 9% . Under conditions (a) through (d), and assuming f ¢ Lx , the follow- 
ing equality holds 


fopu = sup fogou = fol sup eou |. 


ueKyuusv ueKyjusv 


Thus for the topology 3, the function fogoy is a lower-semicontinuous function of 
g. The same property still holds if v is bounded from below (that is infys, v(t) > 
— «) instead of being nonnegative. 

The risk function R(w, 5) is a sum of two terms, R(w, 6) = Ri(w, 6) + Re(w, 4), 
where R,(w, 4) is equal to zero if the probability that the process terminates is 
unity, and to infinity otherwise, and R2(w, 6) is the amount paid when the process 
terminates. Since R2(w, 6) is a sum of terms of the form fogov, and since by 
Assumptions 5 and 6 only a finite number of these terms can be negative, it is 
clear that R.(w, 6) is lower semicontinuous on ®D for the topology 3. Moreover, 
the probability of taking at least n steps is a continuous function of 6 so that, by 
Assumption 5, R(w, 4) is also lower semicontinuous on 9. It is also clear that the 
assumption of lower semicontinuity in (iii) of Assumption 6 cannot be weakened 
if R(w, 5) is to be lower-semicontinuous on the whole of ®. 

The results just established are collected in 
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THEOREM 2. Let D be the family of decision functions satisfying Assumptions 
1 to 4. If Assumptions 5 and 6 are also satisfied, and D is a subset of D, then 

(1) D is a closed convex subset of the locally convex Hausdorff vector space ¥* 
supplied with the topology 3. The risk function R(w, 5) is a lower semicontinuous 
linear function of 6 € D for each w ¢ Q. Furthermore, 


inf R(w, 5) > —« for each w € Q. 
&eD 


(2) In order that D be relatively compact in (QD, 3), it is necessary and sufficient 
that D satisfy also Assumption 7. In this case the closure D and the closed convex hull 
D of D in D are compact in (9, 3). 

In view of Theorem 2, the problem of finding complete classes of solutions can 
be reduced to similar problems considered by Karlin [2] in an abstract setting. 
There is, however, some difficulty due to the fact that the risk function R(w,$) 
can take strictly infinite values. 


5. Complete classes of decision functions. Let A and B be two nonempty sets. 
In this section A will represent the “states of nature’ and B the set of decision 
functions available to the statistician. Let R be an extended numerical function 
defined on A x B. Let H = {x,, --- , x} be a finite subset of A, and let {8;} for 
t = 1, 2, --- , k be k strictly positive real numbers such that >is; = 1. Let 

= {(z,, 8:)} fori = 1, --- , k. Denote by K(g, y) the function K(g, y) = 

*B.R(x; , y). For any subset A’ of A let G4, be the set of g’s corresponding to 
finite subsets of A’. If H is a finite subset of A, let Gy denote the subset of Gy 
for which all the 8,’s are strictly positive numbers. 

The theorems on the existence of complete classes given in the present paper 
are proved in two steps. It is first shown that a result is correct when the set of 
“states of nature’’ is reduced to a finite subset of A or G,. The result is then 
extended to an arbitrary A by a limiting process, using the fact that the family 
> of finite subsets of A is directed and covers A. That is, if S, and S, belong to 
>, then there exists an S;¢ = such that S, U S, C S,; and moreover A C 
Us-x S. The required tool for such a passage to the limit is given by the following 
entirely obvious proposition. 

Lemma 3. Let u be an extended numerical function defined on G, . Let G be a 
subset of G, such that, for every y ¢ B, the inequality K(g, y) S u(g) for every 
g € G implies K(g, y) S u(g) for every g e Ga . Let = be a directed family of subsets 
of G4 covering G. Finally let C be a subset of B having properties: 

(C;) C is supplied with a topology for which it is a compact topological space 
(in the Borel-Lebesgue sense) ; 

(C2) for every fixed g ¢G the function defined by y — K(g, y) ts lower semi- 
continuous on C; 

(C;) for every S ¢ = and every « > O, there exists a y, ¢ C such that K(g, y.) S 
u(g) + efor everyg eS. 

Then, there exists y ¢ C such that K(g, y) S u(g) for everygeG,. 

A particular family = used below is obtained as follows. For a finite subset H 
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of A, let S bea convex subset of Gz spanned by a finite number of points of Gi . 
Let Gz be supplied with the usual Euclidean metric, and assume moreover that 
S is closed in Gy for this metric. It is clear that the family Dy of such subsets of 
Gz is directed and covers G3 . 

Let yo be a particular point of B and assume that K(g, yo) is finite for every 
g ¢ Gy. It is also clear that K(g, y:) S K(g, yo) for every g ¢ Gy implies 
K(g, yi) S K(g, yo) for every g € Gz, provided that K(g, y:) is bounded from 
below on Gz. 

In order to obtain completeness theorems, it will be sufficient to add, to the pre- 
ceding lemma, the following result. 

Lemma 4. Let H be a finite subset of A, say H = {x,,--- , 2%}. Assume that B is 
convex with respect to (H, R), that is, whatever may be y: , y2e BandO S a S11, 
there exists y ¢ B such that 


R(z, y) S aR(xz, y:) + (1 — @)R(z, ye), for every xe H. 


Assume moreover that infys R(x; , y) > —®~ for each x; ¢ H. Let a = 
infyes SUPsen R(x, y). 

Then, whatever b < a, there exists g ¢ Gx such that K(g, y) > b for every y ¢ B. 

Or, equivalently, if b’ is such that whatever g ¢ Gy there exist y, ¢ B such that 
K(g, yo) & 0’, then whatever a’ > b’ there exists y ¢ B such that K(g, y) < a’ for 
everyg eGu. 

This lemma is well known for the case where R(x, y) takes only finite values 
(see for instance Karlin [2]). For a proof readily adaptable to our case see Ville 
[12] and Kneser [13]. The lemma is obvious if H contains only two elements, and 
an extension by induction does not present any difficulties. We will make use of 
the following assumptions. 

AssumpTION 8. For every z ¢ A, inf,.s R(z, y) > — ©. 

AssUMPTION 9. Whatever may be y; , y2 ¢ B andO S a S 1, there exists y ¢ B 
such that R(x, y) S aR(x, y:) + (1 — a)R(z, wy). 

AssumpTION 10. B is a compact topological space and R(z, y) for each z is 
lower semicontinuous on B. 

It is well known and obvious that these assumptions imply the completeness 
of the class of admissibie solutions. 

Let hig) = infys R(g, y) and let Gi be the subset of G, for which h(g) < +. 

‘FueoreM 3. Let Assumptions 8, 9, and 10 be satisfied. If yo ¢ B is such that 
infyec’, K(g, yo) — h(g) = « then there exists y, ¢ B such that K(g, y:) + 3€ S 
K(g, yo) for every g € G4 . Hence the class of Bayes’ solutions in the wide sense is 
complete. 

Proor. It results from Lemma 4 that such a y exists for every finite subset o: 
G*, . Consequently by Lemma 3 there exists a y; such that the condition be satis- 
fied for every g ¢ G, . This result is related to a result of Kiefer [14]. 

If Assumptions 1 to 6 are satisfied and the set D of decision functions consid- 
ered is compact, Theorem 3 implies that the class of Bayes’ solutions in the wide 
sense is complete. To prove this result, Kiefer used the boundedness of the loss 
functions. 
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If G is a convex subset of G, supplied with some topology for which it is com- 
pact, and K(g, y) is lower-semicontinuous for every y ¢ B, and moreover such 
that h(g) is upper-semicontinuous on G, then K(g, y) — h(g) must reach its mini- 
mum on G. For such subsets G, Bayes’ solutions in the wide sense coincide with 
Bayes’ solutions. This applies in particular to the sets S ¢ Ly introduced after 
the statement of Lemma 3. Take then for C in Lemma 3 the closure of the class 
of Bayes’ solutions and apply Lemma 3 twice, first with 2 = 2, for each H and 
then for = = {GZ}, with A finite. This gives 

THEOREM 4. Jf assumptions (8), (9), and (10) are satisfied, the closure of the 
class of Bayes’ solutions is a complete class. 

Let Go be the set of a priori distributions with finite support on Q. Let g = 
{{w:}, «7 = 1---k; {as}, *« = 1--- k} be an element of Go. Denote by 
K(g, 6) the corresponding risk function K(g, 6) = Dra R(w; , 5). From Theorem 
4 we obtain at once 

THEOREM 5. Let Assumptions 1 to 6 be satisfied and let S be a convex subset of 
Go . Let D be a class of decision functions satisfying Assumption 7 and let D be its 
closed convex hull. Let B < D be the class of decision functions 5 satisfying 6 e D 
and such that K(g, 8) = mins-.d- K(g, 8’) for some g ¢ S. Let B be the closure 
of B. Let C be the class of 8’s satisfying 


é<D, inf [K(g, 5) — min K(g, &’)] = 0. 


ge8 é’eD 


Then, whatever may be 5 ¢ D, there exists 5, ¢ BN C such that 


K(g, 6) S Kg, do) for every g € S. 


Remark. The preceding theorem is an extension of Wald’s Theorems 3.17 and 
3.18 ({1], p. 100). Usually the class S can be replaced by a convex class of a priori 
distributions which do not necessarily have finite support. Moreover, an in- 
equality of the type K(g, 5:) S K(g, 5) for every g ¢ S usually impiies that the 
same inequality holds for a larger class. 

This brings us close to Wald’s Theorem 3.19 ({1], p. 101). It is, however, clear 
that Wald meant to assume the convexity of the class ¢ of a priori distributions 
used in this theorem. Wald’s proof uses the convexity of £; it is easy to show on 
examples that without this assumption the conclusion of the theorem does not 
generally hold. This correction being made, it is possible to use our Theorem 5 to 
obtain extensions of Wald’s Theorem 3.19. 


6. Miscellaneous remarks. 

(1) The theorems given in this paper are generalizations of Wald’s [1] Theo- 
rems 3.17 and 3.18. Assumptions on © are required to obtain the equivalent 
of his Theorem 3.20. The same is true of Wolfowitz’s [15] theorems on ¢-com- 
plete classes. 

(2) Wald [1] assumed that the spaces L, of equivalence classes of integrable 
functions on (%, @a , un) are separable. In this case our Assumption 2 is certainly 
satisfied. Moreover, the topology 3 on D admits at each point a countable basis, 
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so that a compact subset of D is also sequentially compact. Consequently every 
admissible decision function is a limit of a sequence of Bayes’ decision procedures. 

In this case it is possible to use general a priori distributions on Q instead of 
the discrete distributions considered in the present paper since, according to 


Fatou’s lemma, / R(w, 5) d§(w) is lower semicontinuous in 6. 


(3) In many problems the spaces (9, @) are countable discrete spaces. In such 
cases the method used here is unnecessarily involved. The topologies 3, become 
topologies of pointwise convergence of the measures ¢(A, 2, 4). 

Thus the separability of K, is no longer necessary. For instance, it is possible 
to choose for T, any compact space, or even any completely regular space, and 
then to let K, be, for instance, the space of all continuous functions on A) . 

(4) We will now give another example of application of Lemma 3. Suppose 
that Assumptions 1 to 6 are satisfied and assume that 7, and W(w, t; \) do not 
depend on X. It frequently happens that under such conditions the statistician 
would be able to find probability measures 6(z, \) defined on T' such that 


r(w, 6, A) = E{a(z, A)eW(w, t) | w} 


is finite for each w ¢ ©, provided only that \ is large enough, say provided that the 
number of elements in \ be larger than some n(w). It is clear that under circum- 
stances, whatever may be the finite set {w, , --- , w,} and whatever e« > 0 and 
whatever may be the decision function 4 , there exists a finite N and a decision 
function 6y terminating surely in not more than N steps such that 


R(w; , dv) S R(w;, bo) + € forevery wie fwi, +--+ , we}. 


If we assume that 7’ is compact this implies that there exists a decision function 
5, which is Bayes’ among those terminating in not more than N steps and which 
satisfies 


R(w; > 5) s R(w; ’ 5o) + 2e, 


According to Lemma 3 the closure of the class of solutions which for some N are 
Bayes’ among those requiring less than N steps is then complete. This has im- 
mediate applications to sequential analysis. 

(5) The assumption of compactness used in Lemma 3, Theorem 3, and Theo- 
rem 4 is obviously too strong. With the notation of Lemma 3, let § be the space 
of all extended numerical functions on G, topologized by the topology of point- 
wise convergence on G,. The space § is a compact Hausdorff space for this 
topology. For each y ¢ C let W, by the function of g defined by g — K(g, y) and 
let F be the family F = {W,;y ¢C} C §&. Furthermore, let F be the closure of 
F in §. The only property actually used in the proofs of Lemma 3, Theorem 3 
and Theorem 4 is that for every v ¢ F there exists a W ¢ F such that W(y) S 
v(g) for every g eG, . This property is the analogue of the property of ‘‘weak 
compactness” used by Wald ({1] p. 53); it will be referred to as property (W). 

Similarly in Theorem 5 the closure B of the class of Bayes’ procedures could 
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be replaced by any class B* containing B and having the property (W). It is 
easy to see that whenever D satisfies (W) the same is also true of the class of 
admissible solutions of D, although these classes might not be compact. 

(6) In many problems it is convenient to compact the spaces 7, instead of 
restricting the set of decision functions to a compact subset of D. For instance, 
let T, be precompact and let its compacted 7, be metrisable. Furthermore, 
assume that for every sequence {t,} C 7, converging to a point & ¢ T, — T) 
the following equality holds 


lim inf W(w, t.;’) = sup W(w, t; A). 
n-2 teT) 
Take for each (w, \) the largest lower semicontinuous extension of W(w, t, A) on 
T, . These Assumptions 1 to 7 are satisfied so that the set D of measurable de- 
cision functions obtained by replacing T, by T, is compact. However, if for in- 
stance 7, is a Borel subset of 7, , every & € D is dominated by some & € D. 
In this case D has the property (W) without being compact. 

As a simple example consider the case where T is for each \ the whole real 
line R. Then 7, can be taken as the extended real line (compacted by the adjunc- 
tion of points at infinity). Let w be a real valued parameter and let W(w, t; A) = 
(w — t)*. Then the class D is not compact but D is compact and every 6 ¢ 9D is 
dominated by the 6 obtained by replacing infinite values of the estimate by say 
zero. The preceding argument gives practical content to a remark of Karlin [3] 
that “every game can be completed to a game having a value.” 

(7) After this paper was written, an article by M. N. Ghosh [16] was brought 
to the author’s attention. Ghosh’s assumptions are stronger than those of the 
present paper. For instance, his Assumptions IV and VII imply Assumption 3 of 
the present paper, and his Assumptions III and IV are substantially stronger 
than our Assumption 6. Ghosh’s theorems on compactness and existence of 
complete classes are special cases of Theorems 2 and 5 of the present paper. 

(8) To give a simple illustration of the relevance of the results of the present 
paper, consider the problem of estimating the mean of a normal population with 
known variance from a sample of fixed size. Take 7 and to be the real line. 
Let W(w, t) be any positive nondecreasing function of r = |w — ¢|, continuous 
on the left and such that lim ,... W(r) = . For instance W(w, t) can be taken 
equal to (w — ¢)*. Then 

(a) Wald’s intrinsic topology on T is usually the discrete topology on T’. 

(b) If W is not continuous the assumptions of [16] are not necessarily satisfied. 

(c) According to Theorem 2 the subclass of decision functions satisfying 
R(w , 6) S M < = for one arbitrary given w is a closed convex compact subset 
of D. 

(d) While © itself is not compact the class of estimates D obtained by allow- 
ing infinite values for ¢ is compact in the corresponding topology. According to 
Remark (6), D satisfies also property (W). 

(e) The class B* obtained by taking the closure in D of the class of Bayes’ 
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solutions and then replacing infinite values of the estimate by zero or even by 
the value of any finite estimate, is a complete class for D. 

Instead of estimating the mean w by a point estimate, it might be desirable to 
give confidence intervals for w. For instance, it might be desirable to obtain confi- 
dence intervals of given length 2/. In such a case take W(w, t) to be zero if 
\w — t} $1 and unity if |w — ¢| > 1. Again allow ¢ to take infinite values. The 
Assumptions 1 to 7 are then satisfied so that Theorem 5 applies directly to D. 
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SEQUENTIAL LIFE TESTS IN THE EXPONENTIAL CASE! 
By BENJAMIN EPSTEIN AND MILTON SOBEL 


Wayne University and Cornell University 


1. Introduction and summary. This paper describes sequential life test 
procedures, considering, as in a recent paper [4] devoted to nonsequential 
methods, the special case in which the underlying distribution of the length of 
life is given by the exponential density 


(1) f(x, 0) = &*""/o, z> 0. 


The unknown parameter @ > 0 can be thought of physically as the mean life. 

Our primary aim is to test the simple hypothesis Hy) : 6 = 4 against the simple 
alternative H, : 6 = 6,, where #, < 4, with type I and II errors equal to pre- 
assigned values a and 8, respectively. The test is carried out by drawing n items 
at random from the population and placing them all on a life test. We consider 
both the replacement case, in which failed items are immediately replaced by new 
items, and the nonreplacement case. 

The test can be terminated either at failure times with rejection of Ho , or at 
any time between failures with acceptance of Hy . Since abnormally long inter- 
vals between failures furnish “information” in favor of Hp and abnormally short 
intervals furnish “information” in favor of H,, these features are not only 
reasonable but actually desirable. Similar problems involving a continuous time 
parameter have recently appeared [3], [5]. 

In this paper we obtain likelihood ratio tests and give approximate formulae 
for the O.C. (operating characteristic) curve, for the expected number of failures 
E,(r), and for the expected waiting time E,(t) before a decision is reached. In the 
replacement case where the number of items on test throughout the experiment 
is the same, namely n, it is shown that E,(t) = (0/n)E,(r). A table giving ap- 
proximate values of E,(r) for certain choices of 6/6, , a, and 8 is given for the 
replacement case. Some calculations of exact L(@) and E,(r) values using formulae 
in [1] and [3] are reported. Several numerical examples are worked out. 


2. Basic formulae. Wald’s work on sequential analysis [8] can be used virtually 
without modification in a situation where decisions are made continuously. In 
fact, in a truly continuous situation, Wald’s formulae become exact, since there 
is then no excess over the boundary. It will become clear as we proceed that, in 
the problem at hand, the situation can be termed semicontinuous (not to be 
confused with the concept of the same name in real variable theory). There is no 
excess over the boundary used for accepting Ho , but in general there will be some 
excess over the boundary used in accepting H; . 

Let us assume that from the underlying exponential p.d.f. (1), n items are 
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drawn at random and placed on life test. We wish to test Hy) : 6 = 4 against 
H,: @ = 6, with type I error = a and type II error = 8. Since information is 
available continuously, a continuous analogue of the sequential probability ratio 
test of Wald can be used. The decision as time unfolds depends on 

(2) B < (60/6:)" exp[—(1/0: — 1/)V(t)] < A 

where B and A are constants, depending on a and 8, such that B < 1 < A. 
The decision to continue experimentation is made as long as the inequality 
(2) holds. At the time the experiment is stopped, if the first inequality in (2) is 
violated, we accept Hp ; if the second inequality is violated, we accept Hi, . 
As in Wald’s case, the test obtained by setting B = 8/(1 — a) and A = (1 — 8)/a 
is a satisfactory solution of the problem from a practical point of view. Details 
are given in remarks 1 and 2 in Section 4. 


In (2), V(¢) is a statistic which can be interpreted as the total life observed up 
to time ¢t. In the replacement case 


(3) V(t) = nt, 


while in the nonreplacement case? 


Vi) = Dn i+ las — ae) + (n= Ut 2) 


(4) . 
= Dx +(n— rit — x), 
t=1 
where zx; denotes the time of the ith failure, with x = 0. 
To graph the data continuously in time, it is convenient to write (2) in the 
form 


(5) —h + rs < V(t) < ho +7, 


where ho , h; , and s are positive constants given by 


ss —log B log A log (60/6 
(6) bye -. hy © geet, ¢ =< 108 (00/6:) 
1/0, — 1/6 1/0, — 1/4 1/0, — 1/0 

Further, it can be shown ([8], pp. 48-50) that the O.C. curve, that is, the 
probability of accepting Hy» when @ is the true parameter value, is given approxi- 
mately by a pair of parametric equations 

A* —1 6/6:)" — 1 
) L(@) = ———, 0= (60/0:)" — 1 3 
A* — B h(1/0; — 1/60) 
by letting the parameter A run through all real values. 

2 In the nonreplacement case it may happen that no decision has been reached by the 
time ¢ = z, , when all n items have failed. This will then require that we either put more 
items on test and wait until (2) is violated or else have a rule which will tell us how to 
terminate the experiment and with what decision at ¢ = z, . Fortunately n is often at our 
disposal and so can be chosen sufficiently large so that the probability of reaching no deci- 
sion by time z, is negligible. For large enough n, it really makes very little difference how 


we truncate experimentation. We could, for example, adopt the rule that H; is accepted if 
(2) is satisfied for allt S$ z,. 
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The values of L(@) at the five points 6 = 0, 0, 8, 0%, and © enable one to 
sketch the entire curve. These values are respectively 0, 8, log A/(log A — 
log B), 1 — a, andl. 

We now give, in terms of L(@), an approximate formula for E,(r), the expected 
number of observations required to reach a decision when @ is the true parameter 
value. Since the logarithm of the middle expression in (2) is either log B or log A 
at the time experimentation stops, we have, neglecting only the excess over log A, 


(8) Ee(r) log (@/0:) — Ee(V(t))[1/A. — 1/62] ~ L(6) log B + [1 — L(6)) log A. 
It is proved in the next section that 

(9) E(V(t)) = 0E¢(r). 

Hence we have from (8) and (9) 


L(@) log B + [1 — L(0)] log A _ hx — L(0)(ho + hr) 


log (00/61) — 0(1/6, — 1/6) s— 0 

[log (60/6:)}? "ie 

If we let k = 6/6, , the approximate values of E,(r) become particularly simple 
when @ = 6, s, or & . They are 


(10) E,(r) ~ 


Ee,(r) ~ [8 log B + (1 — 8B) log A} / [log k — (k — 1)/K], 
(11) Er) ~ — log A log B/ (log k)’, 
E.,(r) ~ [C1 — @) log B + a@ log A] / [log k — (k — 1)}. 


In Table 1 we give E,(r) for five values of 6 (0, 6; , 8, 0 , ©), for four values of 
k (3%, 2, 54, 3), and for the four number pairs (a, 8) which can be made with the 
numbers .01 and .05. 


3. A basic identity. In this section (9) is derived. While this result can be ob- 
tained as a consequence of a theorem of Doob on continuous parameter martin- 
gales ({2], p. 376), a simpler proof is desirable. We shall consider the replacement 
case, where V(t) = nt, although the proof can be trivially modified so as to hold 
in nonreplacement and truncated situations. 

In the replacement case (9) becomes 


(12) E(t) = Eo(r) 6/n. 


Thus we are relating expected waiting time to reach a decision to the expected 
number of failures. 


To prove (12) we introduce a “large’’ integer N and let zy denote the time of 
the Nth failure. Let ¢ denote the (first) time at which the inequality (2) is violated 
or the time zy , whichever comes sooner. Then we can write 


(13) ty = t+ (Sra. — b) + (Sr42 — Seg) ++ + (Ow — Ty-1). 
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TABLE 1 


Approximate values of Es(r) for sequential tests for various values of k = 60/6; 
and a, B 

















Three actions are possible: accept H, before zy , in which case t = z, ; accept Ho 
before zy , in which case xz, < t < 2,4: ; or take no action before zy , in which 
case t = ry andr = N. Since N is fixed in advance 


Further, it is easily verified that the (NV — r) random variables (z,,,; — 4), 
(L-42 — Xr4i),°** , (Cw — 2y-1) are independently and identically distributed 
with the exponential density (n/@)e""*", for zx > 0. Hence if we take the ex- 
pectation of both sides of (14), first holding r fixed and then taking the expecta- 
tion with respect to r, we obtain 


(15) NO@/n = Ep(t; N) + [(N — E,(r; N)]0/n 
or 
(16) Et; N) = E,(r; N)0/n. 


Formula (16) holds for all N. As N — « the probability of coming to a decision 
before zw tends to unity. Moreover as N > « 


(17) Edr;N) 1 Eo(r),  Ee(t;N) 1 Ep(t), 


where E,(r) and E,(t) are respectively the expected number of failures and ex- 
pected waiting time to reach a decision if N = «©. Thus it follows, letting N - ~, 





86 BENJAMIN EPSTEIN AND MILTON SOBEL 


that (16) becomes (12). The nonreplacement case can be treated in exactly the 
same way, because 


Vian) = VQ) + (rn — rir — 2 + (Cn — r — 1) (Grae — Fr41) 


+ os + (an oF Ln-1). 


As before, t = 2, , if H: is accepted; x, < t < 2,4, if Hy is accepted; andi = rz, , 
if no decision is reached by the time all n items have failed. The last (n — r) 
components on the right side of (18) are mutually independent random variables, 
each distributed with the p.d.f. (1). Thus it follows as in the replacement case 
that 


(19) E,(V(t); n) = @E,(r; n). 


As n increases, E,(r; n) 1 E,(r), the expected number of failures in reaching 
a decision in the replacement case. Thus no matter how we decide to terminate 
experimentation, H,(V(t); n) can be replaced by E,(V(t)) = @E,(r), when n is 
large. In practice, for ‘“‘large’’ n one could take n > 3 maxs E,(r). 

While (12) relates expected waiting time to the expected number of failures in 
the replacement case, (19) relates expected total life (not waiting time) to the ex- 
pected number of failures in the nonreplacement case. Actually one has to know 
the probability distribution of r in order to compute E£,(é) exactly in the non- 
replacement case. It can be shown that in the nonreplacement case the formula 
for E,(t) is given by 


(18) 


k 


(20) BXt) = Pr (r= kl EK), Ea(Xan) =O —— 1b. 


In the replacement case one has, analogous to (20), 


, P , ke 
(20’) E(t) = 2) Pr(r = k|0)E(Xe.n), — Ee(Xen) = —. 
where n is the sample size maintained throughout the experiment. Thus, in the 
replacement case (20’) clearly becomes (12). Equation (20) is valid for all life test 
procedures which involve nonreplacement. Similarly (20’) holds for all life test 
procedures, where items which fail are replaced.’ 


4. Some remarks. This section contains three extended remarks on certain 
aspects of Sections 2 and 3. 

Remark 1. Upper and lower bounds for L(@) and E,(r). The formulae for L(6@) 
and E,(r), given by (7) and (10) respectively, are approximations to the actual 
L(@) and actual Z,(r) arising from the use of the semi-continuous sequential 
decision rule specified by the inequalities (2). The question arises as to how good 
these approximations are. A modification of the results of Wald on bounds for the 


* Here, “‘all’? means truncated or untruncated, sequential, or any similar procedures. 
Of course the probability distribution of r does depend on the procedure which is followed. 
In [6] explicit formulae for Pr(r = k | 6) are worked out for three procedures. 
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O.C. and ASN curves in the binomial case [8] and of results of Herbach [7] on the 
discrete Poisson yields the following bounds on the actual L(@) and E;,(r): 


(21) A-1 g1@ < oe ral 


A* — Br (kAy* — BY h ¥ 0 (that is, for 6 * s), 





L(@) log B + [1 — L(@)] log AJ S 
log k — 0(1/@, — 1/6) {3} Ed(r) 


(22) 





{3} L(@) log B + [1 — L(@)][log A + log &] 
= log k — 0(1/0:—1/@) 
where the upper inequality signs hold for @ < s and the lower inequality signs 
hold for @ > s. 

One unpleasant feature of the bounds given in (22) is that they involve 
L(@), which is unknown. However, this matters little in actual practice because 
the limits on L(@) given by (21) are quite close together for the range of values 
of k and (a, 8) covered in Table 1. Thus, for example, for | 


k = 6/=3, a=B=.05, A=(1—)/a=19, B=8/(1—a) = 1/19, 
we get from (21) .95 < L(@) S .983 and .05 < L(@,) S .052. The upper and 


lower bounds for E,(r) given by (22) are close together for @ = 6) and compar- 
atively far apart for @ = 6,. Thus for the case k = 3 anda = 8 = .05, the 
difference between the upper and lower bounds is $.06 for 6 = 6 and is about 
2.5 for @ = 6; ‘ 

The left side of (22) is the approximate formula (10) for Z,(r) except that the 
L(@) in (22) refers to the exact value and the L(@) in (10) is given by the approxi- 
mation (7). In view of the preceding paragraph, the values of E,,(r) given in 
Table 1 are very close to the correct values, while the values of H,,(r) are es- 
sentially lower bounds for the correct value. We cannot say more unless we go 
through more extensive calculations of the sort to be described in Remark 2. 

Remark 2. Some exact calculations of L(@) and E,(r). 

Wald ({(8], pp. 45-46) pointed out that in order to have a test of exactly 
strength (a, 8), the A and B in (2) should be replaced by A* and B*, where 
A* s A = (1 — 6)/a and B* = B = £B/(1 — a). In the present case, with 
information available continuously in time, B* = B = 8/(1 — a) since the 
acceptance of Hy involves no excess over the boundary. However, acceptance of 
H, does, in general, entail a positive excess over the boundary, and all we can 
say initially about A* is that it should lie between A 6,/@ and A. Thus using 
A = (1 — 8)/a instead of A* is an approximation. 

The approximate test based on using A and B is suitable for all practical pur- 
poses, since one consequence of the inequalities (21) is that the strength (a’, 6’) is 
such that a’ S a, 8 S B’ S B/(1 — a). Since a and B are generally small (<.10 
say) a procedure based on A and B provides essentially the same protection 
against errors of the first and second kind as does the test based on using A* 
and B*. However, the use of A rather than A* in (2) will entail a small increase 
in E,(r), particularly for @ < s. 
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As a practical matter, one would usually be content with a test based on (2) 
which uses A and B. As a matter of fact, this is what is done all the time by 
people faced with a practical decision problem. For most sequential problems, the 
problem of finding the A* and B* which will give exactly strength (a, 8) has not 
been solved. One has to rely, in such cases, on the results of Wald which indicate 
that the errors involved in using A, B, and approximate formulae for L(@) and 
E,(r) are ‘“‘reasonably” small. 

In the problem at hand we know, in view of the continuous availability of in- 
formation, that B* = B = B/(1 — a). Furthermore, formulae are available for 
computing A* and fer computing O.C. and ASN curves exactly. The formulae for 
accomplishing these tasks are available [1], [3]. While the computational labor 
involved in any special case is exceedingly heavy, the results of such computa- 
tions do throw some light on how exact O.C. and ASN curves compare with those 
computed by using approximations. 

Formulae (4.17) and (4.23) in [3] (similar formulae are given in [1], p. 102) 
were used to compute 

(i) the exact O.C. and E,(r) curves for the semi-continuous rule (2) with 
B = B/(1 — a) and A = (1 — 8)/a. This was done for the case k = 6/6, = 3 
and a = 8 = .05, and 

(ii) A* (where A @,/@ < A* S A) such that the decision rule 


(2’) B/(1 — a) < (60/6:)"exp[— (1/6, — 1/6) V (t)] < A* 


has an O.C. curve for which L(®) = 1 — @ and L(6@,) = 8 exactly, and then 
to compute E,(r) for the (B, A*) rule. This was done for the cases a = 6 = 
.05 and k = 6/0, = 3/2, 2, and 3, and also fora = 8 = Ol andk = 3. 

The result of (i) was 


L(6) = .968, L(s) = 529, L(@) = .051, 
E,,(r) = 3.08, E,(r) = 8.10, Es,(r) = 7.00. 


Computation (ii) gave 





Eo, (r) Es(r) 


2.94 7.22 
8.64 18.0 13. 
16.6 7.9 | 652.8 36.8 





68.9 5.00 17.5 10. 


Bearing in mind that the computations were carried through only in a small 
number of cases, one can make three observations: 

(a) For the case k = 3 and a = 8 = .05, the use of B = %g and A = 19 
results in getting a’ = .032 and 6’ = .051 as compared with a = 8 = .05 when 
one uses B* = B = Vg and A* = 13.25. Also, E,(r) is increased by .09, .88, 
and .79 at 6 = 4, s, 0 respectively. 
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(b) Of more interest is the fact that the exact values of Z,(r) for the (B, A*) 
rule practically coincide with the approximate values of E,(r) computed for the 
(B, A) rule by formulae (10) and (11) and given in Table 1. 

(c) In the range of values of k = 6/@, and of a and 8 covered by Table 1, a 
good guess at the value of A* is the value A** lying midway between A and 
A/k, the upper and lower limits on A*. This means that A** = (k + 1)A/2k. 
On the basis of our limited calculations we conjecture that in the range of values 
covered in Table 1, a semi-continuous decision rule (2) with A replaced by A** 
will have almost exactly strength (a, 8). The values of E,(r) associated with a 
(B, A**) rule will be given to a close approximation by (10). 

Remark 3. An approximate formula for E(t) in the nonreplacement case. A 
useful approximation to E,(t) in the nonreplacement case is given by E,(t) ~ 
6 log (n/[n — E,(r)]). This approximation is obtained by replacing Eo(X;,,) in 
(20) by its approximation @ log (n/[n — k]). Thus (20) becomes 


: g * ~ tee 
Eft) ~0E, oe (. = :) | 6 log (. — an) 


This approximation has been tested numerically by calculations on truncated 
nonreplacement decision procedures, where the exact values of E(t) can be 
computed and compared with the suggested approximation. The agreement is 
close. 


5. Numerical examples. These methods have been applied to eight problems. 


Problem 1. Find a sequential replacement procedure for testing Hy : @ = % = 
7500 hours against H, : 6; = 2500 hours with a = 8 = .05. The constant number 
of items under test is n = 100. 

Solution 1 (approximate). The (B, A) test (2) becomes in this case 


wc” 6m 


where V(t) = 100¢ hours. For this rule a’ = .032 and p’ = .051. 
Solution 2 (exact). The (B, A*) test (2’) becomes 


J « — V(t) /3750 or 
“<sc”” 6 <¢c BS 


For this rule a = B = .05 exactly. 


Problem 2. Compute E,(r) and E,(t) for 6 = 0, (= 2500), s(= 4115), 
6o(= 7500), «. 

Solution. For the (B, A) and (B, A*) rules, respectively, the values of E(r) 
are given in Remark 2 of Section 4. In the replacement case E,(t) is found most 
easily for all values of 0(# «) by using (12), He(t) = (0/n)Ep(r). 


6 = 0 6; 8 6 
(0 175 333 227 using the (B, A) rule; 


E,{t) = 4 : 
0 155 297 220 using the (B, A*) rule. 





90 BENJAMIN EPSTEIN AND MILTON SOBEL 


For @ = «, the expected waiting time to reach a decision is given by t. , where 
e Mtnl/F _ Vg. This gives t. = En(t) = 110. 
Remark. More generally, in terms of B, n, % , and k, we find 


t, = —6 log B/ n(k — 1). 


This means that if no items fail by t.. , we stop experimentation at ¢,, with ac- 
ceptance of Hy. 


Problem 3. Assume that we are testing the hypothesis in problem 1 and that 
we are using the (B, A) rule. A sample of size 100 is placed on test. Items which 
fail are replaced by new items drawn from the same lot. The experiment is 
started at time t = 0. The first five failures occur at x; = 20.1 hours, x. = 100.5 
hours, x; = 121.7 hours, x, = 167.4 hours, and x; = 179.2 hours, all times being 
measured from ¢ = 0. 

(a) Verify that no decision has been reached by time 2; . 

(b) Verify that if the sixth failure has not yet occurred at 287.5 hours, meas- 
ured from ¢ = 0, we can stop experimentation at that time with acceptance 
of Hy, > 

Solution. It can be readily verified that, in this case, (5) becomes —100 + 
37.5r < t < 100 + 37.5r. This region is drawn in Figures 1 and 2. The life 
test data are plotted by moving vertically so long as we are waiting for the 
next failure to occur and moving horizontally by one unit (in r) at each failure 
time. In Figure 1, the path crosses into the region of acceptance, when r = 5, 
at time ¢ = 100 + (37.5)5 = 287.5. Since the sixth failure has not yet occurred, 
we can stop experimentation at ¢ = 287.5 with acceptance of Ho. 

Remark. As a matter of fact we happen to know in this case that the 
sixth failure occurs at 2, = 346.7 hours. Thus, as indicated in Figure 1, we 
saved 346.7 — 287.5 = 59.2 hours by observing the life test continuously in 
time. 

Problem 4. The first seven failure times in a sample of 100 (with replacement) 
are x, = 19.3, 22 = 45.8, x, = 49.9, 2 = 96.7, we = 115.2, 2 = 127.7, 
and x; = 131.2. Verify that if the hypotheses being tested are those in Problem 1, 
then Hy is rejected at time x; = 131.2 hours. 

Solution. See Figure 2. 

Remark. While the acceptance in Problem 3 is made between failure times 
x5 and 2, the rejection in Problem 4 is made at failure time 2; , with an excess 
over the boundary. 


Problem 5. Find a truncated (nonsequential) replacement procedure for testing 
the hypothesis in Problem 1, using a constant sample size n = 100. 

Solution. From results in [6], it can be verified that the truncated replacement 
procedure meeting the requirements is: 

If min [zy , 407.5] = 407.5, truncate the experiment at 407.5 with acceptance 
of Hy ‘ 


If min [xz , 407.5] = ww, truncate the experiment at x» with acceptance 
of Hy, A 
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The solid lines in Figures 1 and 2 give the boundaries of a sequential with replacement test\of 
Ho 269 = 7500 hours against H, :6; = 2500 hours, witha = B = .05,andn = sample size = 100, 
when one uses a (B, A) rule. For the (B, A*) rule the upper boundary remains the same, but 
the lower boundary becomes the dashed line, t = 37.5r — 88. Figure 1 gives a graphical treat- 
ment of Problem 3. Figure 2 gives a graphical treatment of Problems 4 and 8. 


The O.C. curves of this test procedure and of the one in Problem 1 are es- 
sentially the same. 


Problem 6. Compute E,(r) and E,(t) for the plan in Problem 5 for @ = 0, 
0, , 8, 0, ©. 

Solution. From results in [6], Ee(r) = 10, 9.93, 8.75, 5.39, 0, and E,(t) = 
(0/n)Eo(r). For 6 = 0, 6, 8, %, ©, respectively, E,(t) = 0, 248, 360, 404.5, 
407.5, respectively. 

Remark. In Figure 3 we compare the E,(r) and £,(t) curves for Problems 2 
(using a B, A* rule) and 6. This will give some idea of the saving in the expected 
number of failures and time to reach a decision. 


Problem 7. Find t,, in Problem 1 if a = 6 = .01. 


Solution. t,, = —® log B /n(k — 1) = 230. This is about twice the value of 
t,, when a = B = .05. 
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Fig. 3 
Comparison of Eg(r) (upper portion) and E9(t) (lower portion) curves for sequential and 
truncated with replacement plans. The O.C. curves for each plan are such that L(@.) = .95 


and L(6@,;) = .05, with 6) = 7500 and 6, = 2500. The 110 dashed line gives the value which 
Eo(t) approaches asymptotically as 6 > ~. 


Problem 8. What happens in Problems 3 and 4 if a (B, A*) rule is used? 
Solution. The decision regions are 


(B = Ko, A* = 13.25): —88 + 37.5r < t < 100 + 37.5r. 

No change occurs in the solution of Problem 3, since exactly the same decision 
boundary is being used for accepting Hy . However, the boundary used for re- 
jecting Hy when using (B, A*) is shifted by .32 units (in r) to the left in Figures 
1 and 2. For the data in Problem 4, this results in rejecting Ho at time xs = 127.7 
hours, since for r = 6, we have —88 + 37.5r = 137. This decision to reject 
H, is thus reached with one less item failed and 3.5 hours sooner than in Problem 4. 


6. Acknowledgement. We wish to express our appreciation for the work of Mr. 
Hershel Harrison, who devoted many hours carrying out the calculations, the 
results of which are summarized in Remark 2 of Section 4. 
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RANK SUM TESTS OF FIT 
By Curia Kvuer Tsao 
Wayne University 


Summary. This paper suggests several ‘goodness of fit’ test criteria, all having 
a linear form. The moment generating function and the limiting distribution of 
this linear form are obtained in Section 2. The best test criterion of this form for 
testing a simple hypothesis Hy against a simple alternative hypothesis H, is 
shown, in Section 3, to be in general not independent of H; . 

The remainder of this paper deals with a special case of the linear form, that 
is, the rank sum test criterion. The distribution of this test criterion is derived 
in Section 4, its consistency is proved in Section 5, and some numerical asymp- 
totic efficiencies are calculated in Section 6. Within a certain class of tests, the 
present test is shown, in Section 7, to be uniformly most powerful for a special 
family of alternatives. 


1. Introduction. To test whether a sample X, , X2,--- , Xm of a random 
variable X was obtained from a population having a completely specified con- 
tinuous cdf F(x), a number of tests (e.g., [8], [9]) have been based on a procedure 
by which the domain of the variable is divided into k sets of sizes so determined 
that the probability of each set under the null hypothesis is equal to 1/k. 

Evidently, for any given k, there are many possible ways of dividing the do- 
main of the variable into sets with equal probabilities under the null hypothesis. 
For any given alternative hypothesis and given test procedure, one division 
might be better than another. On the other hand, for any given alternative and 
given division of the domain, one test might be better than another. We shall 
concern ourselves mainly with the latter problem. We assume that some knowl- 
edge of the alternative hypothesis is available. 

The division used in this paper is as follows. Suppose (i) fo(z) and fi(x) are 
two completely specified continuous pdf’s over a space R (which is either R,, or 
a subspace of R,), and (ii) for every real number c the probability of the set 
fa; fila)/fo(x) = c} is zero when the distribution is fo(x). Let H; denote the 
hypothesis that the sample was obtained from f,(x), for i = 0, 1. Then R is to 
be divided into k disjoint sets S, , S., --- , S, such that 


(1.1) S; = (2; Cj-1 a filx)/fo(x) = cj}, J — 5, 2, ore k, 
where the c;, with © = @ >«c> --- > cq = 0, are so determined that 

(1.2) Po. = Poe oo; @ i = 1/k, 

(1.3) Pij [ 5@ dx, j 
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Denote by m; the number of the sample values X, , X:, --- , X» falling in the 
set S; for j = 1, 2, --- , k, and }>m; = m. Several tests based on a linear 
form of m,, m2, --- , m, will be proposed and their properties studied. 


2. Distribution of a general linear form and its asymptotic normality. In this 


section we shall derive the moment generating function (mgf) of the linear 
form 


k 
(2.1) L = >) a;m;, 
j=l 


where a; , d2, --~- a are real constants (not all equal). We shall further show that 
its asymptotic distribution is normal. 


THEOREM 1. Under the hypothesis H; for i = 0, 1, the mgf of L is given by 


(2.2) MAb) = [> py exp (a, | 


Proor. Under hypothesis H; , the distribution of m, mz, --- , m: is known 
to be given by the multinomial distribution 


m 
. 


k 
(2.3) wi(m, m2, ++, m,) = mi TI] (pis)"4/ms!. 
j= 


Hence, by application of the definition, the mgf of L in (2.1), under H; , is given 
by M(t) in (2.2). 

THEeoreM 2. Under the hypothesis H; for i = 0, 1, as m — @ the distribution 
of L in (2.1) approaches the normal distribution with mean and variance 


k k k 2 
(2.4) “i =m dX Q;Pi3, of = ™ bP a5 Dis — (& ps) | 
gm = j= 
Proor. Let Yi, Y2, --- , Ym be independent and identically distributed ran- 
dom variables such that Pr (Y; = a;) = pi; forj = 1, 2, ---,k andi = 0,1. 
Then L is distributed as Yi + Ys + --- + Y,. Hence, by the central limit 
theorem, Theorem 2 is proved. 


3. Most powerful test for testing H) against H,. The main purpose of this 
section is to show that among the tests which depend only on m,, m2, --- ,m, 
the most powerful test criterion for testing the simple null hypothesis Hy against 
the simple alternative hypothesis H; is a linear function of m:, mz, --- , m, 
with coefficients a; as functions of p,; forj = 1,2, --- ,k. 

TxHeoremM 3. The best critical region for testing Hy: f(x) = fo(x) against H,: 
f(x) = filx) is given by the subset of m:, m2, +++ , Me: 


k 
(3.1) dX m; log (1/py) S ¢, 
j=l 


where c is so determined that the level of significance is a preassigned size a. 
Proor. By Neyman-Pearson’s lemma and (2.3), it is easily seen that the best 
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critical region for testing Ho against H; is given by those sets of m;, m, --- 
m, where 


wi(m,, me, °*°° » Mx) eo k eis 
a3 wo(™m, M2, *** , ™M) k I (pij)"’ 2 € 


for some constant c’. Taking logarithms of both sides, we obtain the equivalent 
best critical region determined by (3.1). 

It is seen from Theorem 3 that in order to find the best critical region, one has 
to find first the distribution of the linear function on the left side of (3.1). For 
large samples, the distribution can be approximated by the normal distribution, 
according to Theorem 2. For small samples, however, the determination of the 
distribution is involved. 


4. Distribution of the rank sum criterion. In cases where the alternative hy- 
pothesis is not specified, the statistic on the left side of (3.1) is not applicable, 
since it involves p,;’s. Furthermore, if the alternative hypothesis is stated in the 
composite form, no uniformly most powerful test can be found for most of the 
known distributions. 

However, a class of alternatives may be such that they give rise to the same 
division of R (i.e., same sets S,, S., --- , Sy). Then a rank sum test criterion 
as defined in (4.1) below seems to be a reasonable one to use, since in this case 
all the most powerful test criteria have the form (2.1) with the same property: 
4343 :'- SQ. 

The word “rank’’ is here used in the sense that an observation falling in the 
set S; is given the rank j, for 7 = 1, 2, --- , k. This is different from the usual 
usage of the word in two-sample problems. In the latter case, ranks of observa- 
tions are determined by their relative positions, while here, ranks are determined 
by a given division of the space R. 

THEOREM 4. Let 


A 
(4.1) s = >, jm;. 


j=l 


Then, under Hy , the pdf of s may be written as 


(42) g(s; k, m) = KE" Do (-1)" TK = a hakdlesctts Shasta tte 


r=(0 m—l1 


Furthermore, g(s; k, m) is symmetrical, that is, 


(4.3) g(m + v;k,m) = g(km —v;k,m), v =0,1,---,(k — 1)m. 


Proor. The pdf g(s; k, m) is the coefficient of ¢* in the power expansion of the 
distribution generating function 


(4.4) Dit; k, m) = k™ (x “y. 


j=l 
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This may be written as 


D(t;k,m) = kt" — “)"a -— 


“5 sg - > (—})""" ee e sn 1 + “) perere tr 


p=) g=0 ma-— 1 


(4.5) 


Letting s = m + q+ k(m — p), we obtain the pdf 


bas — . m—-p (m\ (s — 1 — k(m — p) 
(4.6) g(s; k,m) = k 2 (-1) ("") ( ots ). 
Now, setting r = m — p, we get the pdf (4.2). 

The symmetrical property (4.3) may be seen from the following argument. 
Since g(m + v; k, m) is the coefficient of t”*° in D(t; k, m), it is the coefficient 
of (°"*” in D(1/t; k, m), and hence the coefficient of *”~° in “*”” D(1/t; k, m). 
Thus (4.3) is proved, since 


t**)"D(1/t; k, m) = D(t; k, m). 


5. Consistency of the rank sum test. We shall now show that for any given k 
the rank sum test is consistent for a specified alternative or a class of alternatives. 

THeorEM 5. Let k = 2 be a preassigned integer. Let the simple hypothesis Hy: 
f(x) = fo(x) be tested against the simple alternative hypothesis H,: f(x) = fi(x), 
where fo(x) and fi(x) satisfy conditions (i) and (ii) in Section 1. 

Then, for any preassigned level of significance a, the power u(fi) of the rank sum 
test with index k approaches unity as the sample size m becomes indefinitely large. 

Proor. By Theorem 2, the statistic s defined in (4.1), under H; fori = 0, 1, 
is asymptotically normally distributed. Let N(x; u, «) denote the cumulative 
normal distribution with mean yu and standard deviation o. Then, for large m, 
the level of significance and the power of the test will be given approximately 
by 


(5.1) a = N(w — Za0; MO, 90), 
(5.2) u(fi) = N[(uo — wi)/o1 — Zaoo/oi; 9, 1), 


where z, depends only on a, and yu; and oj for i = 0, 1, are given by (2.4) with 
a; = j. 

Since the ratio oo/0; is constant, then to prove Theorem 5 it is sufficient to prove 
that (uo — u:)/o1 increases as m increases, for any k = 2, or equivalently, 


We shall first prove that, for any k 2 2, 
(5.4) Pu > 1/k, Pu < 1/k. 
In what follows, we shall denote by SS” the sets defined in (1.1) and by 


(k) 


pi; the quantities defined in (1.3), that is, 
Si” = S;, Di; = pis, j =1,2,---,k;i = 0,1. 
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Since, by assumption, the probability of the set {x; fi(x)/fo(x) > 1} is positive 
when the distribution is f;(x), then by (1.1), (1.2), and (1.3), we have pi}? > 4 
and p{; < 4. Thus, the inequalities (5.4) are true for k = 2. 
For k > 2, we will prove (5.4) by considering the k sets {S$"’}, for 7 = 1, 2, 
, k; the 2k sets {S$} for 7 = 1, 2, --- , 2k; and the two sets S{? and S$”. 
From (1.1), (1.2), and (1.3), it is easily seen that these sets satisfy the following 
relations 


(5.5) r= SP US”, U Se = si. 


j=l 


Consequently, we find 
(5.6) pir = pir + pir, > pi; = 


. 2k 2k (2k 
Since pii” = pir” = --- = pit” ---, we have 


—— , 2 1 
(5.7) pir = pa + = aN > z. 


 < 1/k. Hence, the inequalities (5.4) are true 


Similarly, we can prove that pi 
for any k 2 2. 
Now, it follows from a special case of the Tchebycheff’s inequality (when 
= | in Theorem 43 o [5]) that for any k = 2, the inequality (5.3) is true, since 
i) and {1/k — pi} are similarly ordered and >(1/k — pi?) = 0. Thus, 
Theorem 5 is proved. 

Theorem 5 implies that a one-sided rank sum test is consistent for the case 
where the null hypothesis Hy: f(x) = fo(x) is simple and the alternative hy- 
pothesis Hf consists of distributions {ff(x)} such that the ratios {r(x) = fi(zx)/ 
fo(x)} are monotonic increasing (or decreasing) functions of x, provided that 
conditions (i) and (ii) in Section 1 are satisfied for each ft (x), when f,(z) is re- 
placed by f? (x) there. On the other hand, a two-sided rank sum test also may be 
shown to be consistent under the following assumptions. 

Suppose it is required to test the simple hypothesis Hy: f(x) = fo(x) against 
the composite hypothesis HT* which consists of two and only two classes C, 
and C; of those distributions such that the ratio f1*(x)/fo(x) is a monotonic de- 
creasing function of x when f?*(x) is in C; and a monotonic increasing function 
of « when f;*(z) is in C.. Suppose, also, that for each ft*(x), conditions (i) and 
(ii) are satisfied, when f(x) is replaced by f?*(x). Then, we obtain 

Tuerorem 6. Let k = 2 be a preassigned integer, and a , a2 , and a be three pre- 
assigned positive numbers such that a, + a. = a where0 < a < 1. Leth; and ho, 
with m S hy < he S km be the values such that 


(5.8) > g(s;k,m) = om, > g(s;k,m) = as. 


s=ho 


Then, the test consisting of rejecting Hy whenever >. jm; S hi or Dy jm, = he 
is consistent for testing Hy against H{*. 
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Proor. Theorem 6 is a corollary of Theorems 4 and 5, considering the two classes 
C, and C, separately. 
Theorem 6 implies that the two-sided rank sum test is unbiased for testing 


H, against H{* for large samples. For small samples, it may or may not be un- 
biased. 


6. Asymptotic efficiency of the rank sum test. In this section, we shall com- 
pare the rank sum test with one of the standard parametric tests, and obtain 
the power efficiency for large samples. 

Suppose a sample is to be drawn from a population having a normal distribu- 
tion with known variance o° and unknown mean @. Let the hypothesis Hy: @ = 
6 be tested against the alternative hypothesis H;: @ = 6,, where #, > &. 
Further, let both the level of significance a = u(6)) and the power of the test 
u = u(6;) be specified in advance, for example, a = .05 and u = .95. 

Let M and m be the sample sizes required by the likelihood ratio test and the 
rank sum test, respectively. We shall call § = M/m the efficiency of the rank sum 
test. 

When d = (6, — 6)/o is small, so that the sample size m is large, we can use 
the normal approximation (5.2) for the power function of the rank sum test. 
Hence, m is approximately given by 


(6.1) aes (* V (= 1/12 + 2 VEE Pp — Ci ins) 

r 1/]- ¥- ’ 
a(k + 1) — 2h jp 

while M is given by 


(6.2) M = (2a + 2u)o°/(0, — 0%)’, 


where z, and z, depend only on the specified values a = u(@) and u = u(@), 
respectively. Consequently, the efficiency is given approximately by 


an ca Ht (= Mk +1) — 2h pw y 


@aV (k® — 1)/12 + au VEE Ppa; — (ZF jp)? 

The asymptotic efficiency may be found by evaluating the limit lim g—»6&. 
Thus, letting n(x; 6, ¢) denote the normal density with mean @ and standard 
deviation o, we obtain 

THEOREM 7. Let k 2 2 be a preassigned integer. Then, for any preassigned 
aand u with u > a, the asymptotic efficiency (as d — 0) of the rank sum test with 
index k is given by 


12 k-1 2 
(6.4) & = om 2» n(y;;9,1)], 


where the y;, with = =y>y>-:: > ye = —~%, are so determined that 
(6.5) N(yj-1; 0, 1) — N(y;;0, 1) = 1/k, 
Proor. It follows from the definition of p;; that 


ad 


(6.6) pis = N(xjn; 6;, 0) — N(x;; 6;, ), j =1,2,--- 
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where the z;, with © = a > 1 > --: > a = —®, are so determined that 
Equation (1.2) is satisfied. Since limg_.opi; = po; , we have 


. k 2 
OY! atom pre | Seslg— edee) /) 


The limit in square brackets is an indeterminate form. However, the numerator 


and denominator satisfy the assumptions of |’Hospital’s rule. Consequently, 
we obtain 


1 a ; 
(6.8) gs = — bP oj{n(x;-1; 00,0) — n(x; ; 60, | 


From (6.5) and (6.6), it is easily seen that y; = (x; — %)/o forj = 0,1, --- 
Thus, the asymptotic efficiency &’ may be written as 


12 [fs F 
& = e-1 bP Jin(y;- ; 0, 1) — nly; ; 0, D3] 
; Naa j=l 


(6.9) 2 
12 
am afer | ny;1;0, 1) — kn(y ; 0, »| 


~~ Lie 
By assumption, n(yo; 0, 1) = n(y; 0, 1) = 0. Therefore (6.9) becomes (6.4). 
This completes the proof of Theorem 7. 


We remark that although the asymptotic efficiency &’ was obtained under the 
assumption that a and wu are preassigned, it is actually independent of them. 


TABLE I 


Power Efficiencies of the Rank Sum Tests 


el 2 3 A 





637 -636 -636 -635 

.793 793 .794 .794 794 

856 857 .857 -858 859 

.888 . 889 .890 .891 .892 

.906 .906 . 908 . 909 911 
.918 918 -919 -920 -921 .923 
.926 .926 .927 .928 .929 .931 
.931 .931 .932 .933 .934 .936 
.935 .936 .937 .939 -940 .942 


OOIPAhwrw i 


o 


Table I gives the asymptotic efficiencies (d = 0) and certain approximate effi- 
ciencies (d = .1, .2, .3, .4, .5) fork = 2,3, --- , 10. The approximate efficiencies 
were obtained under the assumption that a = 1 — u (where a is small). 

For 0 < d S .5, the approximate efficiencies in Table I are very close to the 
exact ones. We note also that .637 = 2/7 is just the power efficiency of the large 
sample binomial test, since the rank sum test reduces to the binomial test when 
k = 2 (see also [2], [4]). 
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7. Power of a uniformly most powerful rank sum test. We have shown that 
the rank sum tests are consistent, and the numerical calculations show that their 
asymptotic efficiencies are approximately over 90% for the normal alternatives, 
when k = 6. However, these are only the limiting behavior of the tests. Naturally, 
the power of the rank sum tests for small samples is also desirable. It is the pur- 
pose of this section to investigate the power of the rank sum tests for a special 
family of alternatives. This family is so chosen that among the tests which de- 
pend only on m, m2, --: , m,, the rank sum test is uniformly most powerful 
for testing the uniform distribution against such a family. 

Let a family of cdf’s be given by 


[z, A=1, 
(7.1) F(x; A) = 
\(A* — 1) /(A—1), A>1, 


Let the hypothesis Hj: A = 1 be tested against the alternative hypothesis 
Hi: A > 1. Then, 

THEOREM 8. Among the tests which depend only on m,, m2, --+ , m , the rank 
sum tests are uniformly most powerful for testing Ho against H; . The power func- 
tions are given by 
k™A™(AN* — 1)” + 


u(A;k,m) = - (A = 1) g(s; k, m)A~**, 


where the level of significance is 


(7.3) ve g(s; k, m) = a. 


2=m 


Proor. Under Ho, F(x; A) is just the edf for the uniform distribution on 
(0, 1). Therefore, according to the assumptions in Section 1, we have 


i * k-j k-j+1 
(7.4) S; - = ait}), 
Hence 

ACH HDR 4G Dike 4 athe getty 


2 we ee 


Thus, by (3.1), the best critical region is given by 


k 

1 
e m; log (+) 
j=1 Pri 


(7.6) 


k 
= log A™" > jm; + m [log (A — 1) — log (A“*”“ — A)] S «. 
j=l 


Since A > 1 and the second term is constant, we have the equivalent best critical 
region determined by 


k 
(7.7) Dd jm; < c*. 
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It is obvious that for any given level of significance a the best critical region 
determined by (7.7) is independent of the parameter A. Consequently, the rank 
sum test is uniformly most powerful for all A > 1. Thus, we have proved the 
first assertion of Theorem 8. 

The power function of the test is derived as follows: 


u(A; k,m) = Dom iT eo” 


j=l m;! 


Saat 9A a 


Foal sai 7 


— +1)/k a Er mI] 


(. A — j=l 


( Aen — 


Tees /k 


a - Dm! II ache 


(A — 1)" y=1 k™m;! 


A 4™ A” Pe: 1 k” c* a 
= 4 ~ ae DX g(s; k, mA", 


where the summation y is extended over all possible combinations of m, , me , 

- , m such that m S >>jm; < c* and }\m; = m. This completes the proof 
of Theorem 8. 

In Figure 1 are plotted six power curves u(A; k, m) for k = 2,3, 6 and m = 
4, 6, comparing the power curves of the rank sum tests with indices k = 3, 6 
with that of the binomial tests; when k = 2, the rank sum test reduces to the 
binomial test. The levels of significance (nonrandomized) are 


u(1; 2,4) = 0625,  u(1;3,4) = .0617, u(1;6, 4) = .0540, 
u(1; 2,6) = .1094, u(1; 3, 6) = .1070, u(1; 6,6) = .0965. 
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The family of distributions F(z; A) not only yields nice power functions for 
the rank sum tests, but also possesses the nice property that A plays the same 
role as a location parameter in the sense that the mean p» = A/(A — 1) — IL, 
log A is a monotonic increasing function of A. For, letting y = log A, we have 


(7.9) uw = e’/(e’ — 1) — I/y, 


and hence 


(710) =~ Wve _ ( — 1 + yee — 1 — yell) 
3 dy y*(ev — 1) y(e¥ — 1)? 


Now, when y > 0, we have 


/ 1 1 1 1 
(7.11) e -—-lil- ye” = (3 — mY ar (7 — ogi) ¥ a --- > 0. 


Consequently, » is a monotonic increasing function of y, for y > 0, and hence 
of A, for A > 1. 

Since A plays the role of a location parameter, the class of alternatives F(x; A) 
may be regarded as representative of the principal types of deviation from the 
null hypothesis. To show the general shape we plot, in Figure 2, five curves of 
this family along with five curves of normal alternatives N(x; 9, o), where the 
normal distributions are transformed by § = N(x; 6, 0). The family F(z; A) is 
shown by solid curves, while the family N(x; @, «) is shown by dotted curves. 
In the latter case, the letter d represents the distance of the mean 6 from the 
hypothetical mean in terms of the standard deviation ¢, that is, d = (8 — %)/c. 


eM Od 
PTT TTT ee 
7 EET TT VA 
A 
PTT TT rare 


4 
/ 


F(x,A) & N(z,9 +do,o) 


> L: 

Aisi {| | | 

0.| 0.2 03 04 05 06 0.7 08 09 1.0 
x & N(z, 8,0) 


Fic. 2 
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Figure 2 shows that certain normal alternatives (when d is small) can be ap- 
proximated by certain alternatives F(x; A). Therefore, for a fixed level of sig- 


nificance their corresponding power curves can be used as approximations to 
each other. 


The author wishes to express his appreciation to the referee for valuable com- 
ments and suggestions. 
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RANDOM FUNCTIONS SATISFYING CERTAIN LINEAR 
RELATIONS, II’. 


By 8. G. Guuryre 
University of North Carolina 


0. Introduction and summary. We consider here another aspect of a prob- 
lem mentioned in a previous paper [2]. We shall be concerned with one-dimen- 
sional, real-valued random functions (r.f.) X(¢), defined for all ¢ and such that 
any sample taken at equidistant ¢-points satisfies a linear relation which is an 
analogue of one or other of the stochastic difference relations which are used for 
the analysis of discrete-parameter time-series. More specifically, we assume that 
there exist k continuous and real-valued functions a;(h), --- , a.(h) of h = 0 
such that for any h > 0 and any ¢, the sequence 


(1) {X(t + [n + klk) + on(h) X(t + [n +k — Uh) + --- + ar(h)X(E + nh)}, 

a=’ @, +I, °°: 
satisfies certain conditions about independence or noncorrelation. In Section 1, 
we consider hypotheses concerning correlation, and find that the functions 
a;(h) are restricted to certain forms. We also find that the assumption of zero 
serial correlations in the sequence (1) for all h > 0 implies that X(¢) is deter- 


ministic. In Section 2, we consider hypotheses concerning independence, and 
find the functions a;(h) to be restricted as before. 


i. Hypotheses about correlation. In this section, we assume X(t) to have a 
finite variance and to be continuous in mean square for all ¢. We shall consider 
first processes with stationary covariance, and then all processes with continu- 
ous covariance. Although the former case is included in the latter, we find that 
the restriction of stationarity enables us to consider somewhat less restrictive 
hypotheses. By analogy with the definition of ““m-dependence”’ [3], we shall use 
the following 

Dertnition. If {X,} has a finite variance for all n, and X, and X,, are non- 
correlated for |n — n’| > m, the sequence {X,} is said to be m-correlated. 

THEOREM 1. Let X(t) be a random function with a continuous, stationary co- 
variance, and let there exist a positive integer m and a set of k real-valued, continuous 
functions a;(h), a2(h), --- , ax(h) of h = 0, such that 

(i) for any h > 0, the random variables 


Y(a’;h;n) = X([n+ kh) + ai(h)X([n + k — 1h) +--+ + an(h)X(nh), 
n= 0, +1, tee 


(2) 


form an m-correlated sequence; 
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(ii) there is no h > O for which such a relation holds for some m with less than 
k coefficients, say B:(h), Bo(h), --- , Brlh), with | < k, instead of the a;(h). 

Then there exists a uniquely determined set of k continuous, real-valued functions 
a(h), --- , ax(h) with the following properties: 

(a) For any h > 0, the sequence {Y(a;h;n)}, forn = 0, +1, --- is (k — 1)- 
correlated, that is to say m = k — 1. It is (k — 2)-correlated if and only if X(t) 
is deterministic and satisfies the relation 


(3) X(t + kh) + an(h)X(t + fk — Wh) +--+ + a(h)X@ = 


with probability 1 for any h > 0 and any t. 
(b) Every root y;(h) of the equation in zx, 


(4) a + a(h)c* + --- + a (h) = 


can be written in the exponential form exp (A;h), where the d; are independent of 
h and are roots, of respective multiplicities k; , of an algebraic equation of degree 
k with real coefficients which are independent of h. Further, the real parts of the 
A; are nonpositive, and k; = 1 if \; is purely imaginary. The root exp (A;h) of (4) 
has multiplicity k; . 

Proor. It is no restriction to assume E{X(t)} = 0 and E{X°*(t)} = 1. We 
shall also write p(h) for E{X(t)X(t + h)} and define the operator U, by 
Unf) = ft + h). 

Taking ao(h) = 1, and using the m-correlation property of the sequence (2), 
we have for any h > 0 and for any integer n > max (m — k, 0) 


( k : be k : 

(5) 4 z a(h)U; ; {2 acres} p(nh) = 0. 
\j=0 j=0 

Thus for any h > 0, we have a linear difference equation satisfied by the sequence 


p(nh). Hence, p(nh) can be expressed as a function of n and the roots of the 
characteristic equation 


(6) iz asthe ‘z as i) z= (). 


For the a let us consider some fixed h > 0, and let y;(h) forj = 1,2, --- 
p,p+1,---,p + p’, be all the distinct roots, of moduli not euceoding l, of 
equation 6): let k; be the multiplicity of the root y;(h), and let 
(= 1 for j _ 1, 2, tan 
(7) vith) | 4 

<1 forj=p+lpt+2,---,pt+p’. 


Since the reciprocal of any root of (6) is also a root, we see that the whole set 
of distinct roots consists of 


vi(h), j= 1,2,---, ptf’, 1/y;(A), j=ptl,:--,pt+p, 
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each root with suffix 7 being of multiplicity k; . Hence, for all integersn > max 
(m — k, 0), we get from (5) 


oink) = © ih) ayn’ + E7o{S bul’ 


j=p+ 


(8) ae ait 
+ _ ¥;"(h) ‘= cain, n > max (m — k, 0), 


j=pt+l 


where the a’s, b’s and c’s are constant with respect to n, but continuous functions 
of h. Since |p(nh)| < 1, the last term in (8) drops out entirely and there can be 
no positive powers of n in the first term on the right side of (8), so that 


P pP+p’ kj—-1 
(9) p(nh) =, , 75 (h)ajo(h) + bs > ‘= bin’, n> max(m—k, 0). 
= J=P+ s= ) 
Therefore, the sequence {p(nh)} satisfies a homogeneous, linear difference 
equation (with right member zero) of order k’ = p + DJ -k + ; - Now, the roots 
of (6) comprise the roots of 


(10) a* + a(h)a*" + --- + a(h) = 0 


and their reciprocals. Hence, it follows that every root of (6) of unit modulus 
is of even multiplicity. Consequently, it is easy to see that k’ > k. On the other 
hand, if k’ < k, we can use the fact that the sequence {p(nh)} satisfies a linear 
relation of order k’ to show that condition (ii) of the theorem is violated. Thus 
k’ = k, and for every h > 0 there exist k real numbers a;(h), --- , a.(h) such that. 


(11) > ah)p(in — jh) = 0 anyn> m = max(m, k) 


j=0 


This set of k numbers is unique for every h > 0, since if there were two non- 
identical relations of order k of the type of (11), we could derive from them 
a relation of lower order, and this would contradict assumption (ii) of the 
theorem. The equation 


(12) a + ay(h)c** + --- + a(h) = 0 


has p distinct, nonrepeated roots 7;(h), where 7 = 1, 2, --- , p, of unit modulus, 
and p’ distinct roots y;(h), where j = p + 1, --- , p+ p’, of moduli less than 
1 and respective multiplicities k; . 
From (11) we know that for any h > 0 and any integer r > 0, the sequence 
p(nh/r), forn = m +1, m + 2, --- , satisfies the relation 
k 


(13) LX ah/r)ol(n — j)h/r} = 0. 

j= 
From (13) we shall now derive a relation satisfied by the sequence p(nh). For 
this purpose, let a:(r; h/r), ae(r; h/r), --+ , ax(r; h/r) be the set of numbers 
determined uniquely by the property that the roots of 


(14) a” + a(r; h/r)a* + +++ + om (r; h/r) = 0 
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are the rth powers 7j(h/r) of the characteristic roots of (13). Let 6; , fori = 
0, 1, 2, --- , be defined by the identity 


rk—k kr (k—-Dr 
pent ft an(r; h/r)x + +++ + a(r; h/r) 

am 2X o- re z* + ay(h/r)z*? + -++ + ax(h/r) 
Then it is easily verified that 

rk—k k k 
(16) 2d B; » a;(h/r)p{(nr — i — j)h/r} = 2 air; h/r)p{(n — j)rh/r}. 
Consequently, 

k 


(17) 2» a,(r;h/r)p{(n — j)h} = 0 n> mM. 
But the uniqueness of (11) gives us a;(r;h/r) = a;(h) and hence yj(h/r) = y;(h). 
Then, by a standard argument using continuity, we have y;(h) = exp (Ajh) 
for all h = 0, where ); is some constant. We have thus proved (b). 

Next, from (9) by equating the expressions for p(nh) and p(h’), so that h’ = nh, 
we get 


ajo(h) = ajo(nh), bje(h)n® = bj(nh). 


This gives us ajo(h) = aj and b;,(h) = b;,.h°, where the aj and b;, are constants. 
Hence, 


p’ p+p’ kj—1 
(18) p(h) = >> aj exp (A;h) + » - b;. h’ exp (A; A), h> 0. 
j=l 


j=p+1 s=0 


From this form of p(h), we immediately have 
(19) E{Y(a;h;0)X(t)} = 0 h>0, ¢ts0O. 


It follows trivially that the Y-sequence is (k — 1)-correlated. Thus the first part 
of (a) is proved. 


Finally, suppose that the Y-sequence is (k — r)-correlated for some r 2 2. 
This together with (19) implies that 


(20) E\Y (a; h; j)X(rh)} = 0 j= 1,2,- 
Also, since (k — r)-correlation with r = 2 implies (k — 2)-correlation, we have 
(21) E{ Y(a; rh; 0)X(rh)} = 0. 
Now, by the procedure used in (14) to (16), we can obtain the relation 

Y(a; rh; 0) = BoY(a;h; rk — k) +--+ + BurzY(a; h; 0), 
which leads to 
(22) E{Y(a;h;0)X(rh)} = 0. 
This implies that the Y-sequence is (k — r — 1)-correlated. Hence, by induction 
we can show that the assumption of (k — 2)-correlation in the Y-sequence 
implies 
(23) E{Y*(a;h;0)} = 0, 


which proves the second part of (a). 
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Remarks. The uniqueness of the coefficients a;(h) is a consequence of the 
restriction |y;(h)| < 1. There is another unique set of k coefficients under the 
restriction |y;(h)| 2 1; in this case the roots are reciprocals of those in the pre- 
vious. This is merely a consequence of the fact that, on account of stationarity, 
the covariance function of Y(t) = X(—t) is the same as that of X(t); the reversal 
of the /-axis transforms the linear function with characteristic roots y,;(h) into 
one whose roots are 1/y,(h). 

This result may be compared with some of the results of Doob [1]. The first 
k — 1 derivatives in mean square of a stationary r.f. exist if and only if p(h) has 
a derivative of order 2(k — 1) at the origin, and this condition is completely 
equivalent to the finiteness of the moment of order 2(k — 1) of the spectral 
function. From these facts and Theorems 3.10, 4.8 and 4.9 of Doob [1], we can 
derive the 

Coro.iary. A one-dimensional, stationary Gaussian process is a component of 
a k-dimensional ‘“‘t.h.G.M.” process if and only if it is a Gaussian process satis- 
fying the assumptions of Theorem 1. Furthermore, it is a ‘‘t.h.G.M,” process if 
and only if, in addition, its (k — 1)th derivative in mean square exists. 

We shall now state a result similar to Theorem 1 which holds without the 
restriction of stationarity. 

THEOREM 2. Let X(t) be continuous in mean square for all t, with E{ X(t)} = 0. 
Let there exist a positive integer m, and k continuous functions, a,(h), --- , ax(h), 
of h = O, such that 


E{(X(t + kh) + an(h) X(t + [k — 1h) +--+ + on(h)X(O|X(t — nh)} = 0, 


n=m, m+1,-::-, 
assuming that such a relation does not hold with any other set of a’s for any h (and 
any m). 

Then the roots of (4) can be written in the form exp (A;h), where the \; are the 
roots of an algebraic equation of degree k with real coefficients. Furthermore, (24) 
is true for all integers n = 0, and if it also holds forn = —1, then it holds for all n, 
and Equation (3) is true with probability 1. 

The proof is similar to that of Theorem 1, and is thus omitted. 


2. Hypotheses of independence. Finally, we shall consider a result of this 
type, but with noncorrelation replaced by independence. We shall see that the 
Y-sequence is necessarily (k — 1)-dependent, but we are unable to determine 
whether it can be (k — 2)-dependent without triviality. 

THErorEM 3. Let X(t) be a real-valued rf., continuous in probabili:y for all t. 
Let there exist a positive integer m, and k real-valued, continuous functions 
ah), --- ,ax(h), of h = O such that 

(i) for any t and any h > 0, the random variables 


Y(t, h;n) = XC + [n + kh) + (AX + [n +k — 1h) + -:- 
+ ox(h)X(¢t + nh), n=0,+1,::-, 
form an m-dependent sequence; 
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(ii) there is no other set of a’s for which this is true for some m; and 

(iii) ax(h) # O for any h. 

Then the roots of (4) can be written in the form exp (A;h), where the d; are roots 
of an algebraic equation of degree k with real coefficients. Furthermore,m = k — 1. 

Proor. As before, we take any positive h and any positive integer r > m — k, 
and let h’ = h/r. On account of m-dependence, we know that, for any integer 
| > mand any positive integers p and q, the set of random variables { Y(t, h’; n)} 
forn = 0,1,---, (p + k)r is independent of the set {Y(t, h’; —l — n)} for 
n=0,1,---, (q+ k)r. Now let 

kr—k 


(25) S.(r) = >> B Y(t, h’; nr + kr —k — 5), 
j=0 


kr—k 
T.(r,l) = >> 6; Y(t,h’; —nr —1— 5) 
j=0 


(26) 


kr—k 


> 8 Yit+ (k — DW, W; —nr —k — ji, 
j7=0 


where the 8; are as in (15). Then the random variables S,(r) forn = 0, 1, --- 
are independent of 7',(r, 1) forn = 0,1, --- , q. 

By the method used in (14) to (16), we shall now derive a new linear difference 
function which generates a sequence having the properties of {Y(t, h; n)}. 
For this purpose, let 


Y'(t,h,n) = X[t + (n + kjh] 
+ a (r; h’)X[t +(n + k — 1h) + +++ + ax(r; h’)X[t + nh]. 

Then it is easily verified that 
(28) S,(r) = Y’(t,h; n), T(r, l) = Y'[t+ (kK —Dh'’,h; —n — kj. 
For 1 = r + k, we have from the second expression that 
T.(r,r +k) = Y'(t — rh’, h; —n — k) 

= Y’'(t,h; —n — k — 1). 
Since the S,(r) for n = 0, 1, --- , p are independent of T,(r, r+ k) forn = 


0,1, ---,q, it is clear that the Y’-sequence is k-dependent. Hence, by assumption 
(ii) of the theorem 


(30) Y'(t,h;n) = Y(,h;n), 


so that a;(r; h/r) = a;(h). This leads as before to y;(h) = exp (A;h). 

Finally, from (28) and (30) we know that for any 1 > m and any positive 
integers p and q, the random variables Y(t, h; n) forn = 0,1, --- , p are inde- 
pendent of Y[t + (k — Dh/r, h; —n — kj forn = 0,1,---,¢. Withl = 
m+ 1,asr— o the second set of random variables converges in probability to 
Y[t, h; —n — k] for n = 0,1, --- , g and therefore is independent of Y(r, h; n) 
for n = 0, 1, ---, p. In other words, the Y-sequence is (k — 1)-dependent, 
which is to say that m = k — 1. 


(27) 


(29) 
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Corouuary. Any random function X(t) having the property that for any t and 
any h > O the increments [X(t + h) — X(8), [X(t + 2h) — X(t + h)], --- form 
an m-dependent sequence, where m is some nonnegative integer, is a random func- 
tion with independent increments (“additive process’). 
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ON THE DISTRIBUTION OF THE SAMPLE MEDIAN! 
By Joun T. Cuvu 


University of North Carolina 


1. Summary. Upper and lower bounds are obtained for the cumulative distri- 
bution function of the sample median of a sample of size 2n + 1 drawn from a 
continuous population. It is shown that if the parent population is normal, then 
the distribution of the sample median tends “rapidly” to normality. Other kinds 
of parent populations are also discussed. 


2. Introduction. Let a continuous population be given with edf F(x) (cumula- 
tive distribution function) and median ~ (assumed to exist uniquely). For a 
sample of size 2n + 1, let % denote the sample median. The distribution of 2, 
under certain conditions, is known ([2], p. 369) to be asymptotically normal 
with mean é and variance o, = 1/4 [f(£)]*(2n + 1), where f(x) = F’(x) is the pdf 
(probability density function). 

Several authors, among them Hojo [4] and Cadwell [1], have stated that 
numerical investigations showed that, if the parent population is normal, ‘the 
convergence (of the distribution of %) to normality is surprisingly fast.’? How- 
ever, no mathematical proof or disproof seems ever to have been given for this 
experimental result. 

This paper shows mathematically that the findings are correct. Upper and 
lower bounds are obtained for P[—z < (% — &) / on < yj in (8) and (9). If no 
very high accuracy is required, these bounds are reduced to a simpler form in 
(10) and (11). Examination of these bounds makes it evident that the distribu- 
tion of (4 — £) / o, tends “rapidly” to normality. 

Rectangular and Laplace parent populations are briefly discussed. It seems 
that in these cases the distribution of ( — £) / o, tends to normality at a “much 
slower speed.” 


3. Upper and lower bounds. Let F(x) and f(x) be respectively the cdf and pdf 
of a certain population whose median is £. If g(x) is the pdf of the sample median 
% of a sample of size 2n + 1, then 


g(x) = C,[F(x)]"[1 — F(x)]"f(x), C, = (n+ 1)!/nin!. 


If f(£) * O and f’(zx) is continuous in some neighborhood of z = &, then Z is 
known ([2], p. 369) to have an asymptotically normal distribution with mean 
£ and variance 
9 1 
On = aoa —, 
4[ f(é)}? (Qn + 1) 
Received June 11, 1954. 
1 Special report to the Office of Naval Research of work at Chapel Hill under Contract 
N7-onr-28402 for research in probability and statistics. 
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For finite n, let the edf of ( — £) / o, be H(z). Then for any y > 0, 


E+yen F(E+yeq) 
H(y) -3=/ g(t) dt = c.f a (1 — u)* du 


F(t+ve,)—1/2 
= (3)™ Gf (1 — 4p)” dv. 
0 


Applying the transformations 


a’, O<asl; 


US io? 2h v = 3/1 — exp [—F/(2n + 1)), 


we obtain without difficulty 


| n+1, t 
(1) Hy) - 3 L Var exp | 3 o it] m x + i) * 


0O<as 


on P| on +1 (Te +1)™ 


where B, = (3)°"7'C,.+/2e / ~/2n + 1 and 
(3) h(t) =t/ V1 — exp (—B), ho(t) = texp (—f’) / V1 — exp (—8); 


th = V—(2n + 1) log {1 — (4/a*) [F(E + yon) — 41}, 


(4) Pbned cet PeA 
te = V—(2n + 1) log {1 — (4/0*) (FE + you) — HPF. 


It can be shown (by differentiations) that h,(¢) and h2(t) are respectively mono- 
tonically increasing and decreasing functions of ¢, when ¢ 2 0, and that 
limyse Ai(t) = limyso ho(t) = 1. Hence we obtain from (1) and (2) 


Hy) — 4 & aBn 4/1 — ago (4 4/22) - 4} 
H(y) — 3 & bB, y/ +56 (4 4/57) - 3} 


(5) ot) = | (1//2m) exp (—42*) dz. 


where 
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In a similar way we can show that, for arbitrary zx > 0 and y > 0, 


H(y) — H(—z) 


—— ‘m+2\_.(_, ,/mt2 
= aB, V3 - aa ¢ (1 at?) 6( 4/2?) | 


H(y) — H(—2) 


1 2n 
0B. 4/1 +E [6 (4/55) -(-4 4/55) | 
where ¢; and & are obtained from ¢, and & in (4) by replacing y by —z. 
It can be seen from (4) that if z and y are fixed, 4) = & = y + O(1) ands = 
t, = x + O(1) for large n. The following sections will show, for various kinds of 
parent distributions, that if a and b are properly chosen, then (6) remains valid 
if t; , f and ¢, , t4 are replaced by y and z, respectively. 


If n is large, upper and lower bounds for B,, can be obtained by using Stirling’s 
formula. Feller [3] showed that for n 2 4, 


(6) 


~~ lt @+0 / 
i +1/2 c — ‘7 ——_-_ < 1 e 
n! = V/2en exp | n+ ae |6| 3% 


If the last term, —(1 + 6) / 360n’, is omitted, then it can be shown that 


- A 7n + 3 
8n  24n? (2n + 1) 


1 


om 16n (8n — 1)’ 


<B.<14+i4 
8n 


or B, ~ 1 + Mn. 


4. Normal parent population. Suppose that a sample of size 2n + 1 is drawn 
from a normal population with mean £ and variance o’. The distribution of 7 
is then asymptotically normal with mean £ and variance ro’ / 2(2n + 1). It has 
been shown that if, for x > 0, 


(7) ¢(z) — o(—2z) = a(x) V/1 — exp [—(2/x) 2%), 


then a(x), a function of x, never exceeds 1 and is very close to 1 for all values of 
x > 0. Williams [6] proved that a(x) < 1 and tabulated 1/a(x) — 1 for a number 
of values of x ranging from .1 to 2.0. Pélya [5] gave several proofs for the same 
inequality and remarked that if ~/1 — exp [—(2/7)z?] is used as an approxima- 
tion to ¢(x) — ¢(—z=), “then the error committed is less than one per cent (even 
less than .71 per cent) of the quantity approximated.” In other words, a(x) > 
.9929 for all x > 0. 
For arbitrary x > 0 and y > 0, let 


In = Vx/2 2 QIn+1, yo= Vr/2 y/V2n4+ 1. 
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Applying (7) to (6) yields 
H(y) — H(—2) 2 min {a(z,), a(yn)} 


(8) i. 2n + 2 Qn + 2 
Ba g/t ~ stg |o(u 4/22) - 0 (-2 4/2+2)], 


H(y) — H(—z) 


(9) s Ba 4/1 + | 6(u 4/ gq) -6(-2 4/5) | 


where ¢(x) and a(x) are defined by (5) and (7). If no very high accuracy is re- 
quired one may use 


(10) H(y) — H(—z) = .9929 (1 + len) V/1 — 1/(2n + 2) [o(y) — o(—2)I, 
(11) H(y) — H(—z) S (1 + Kn) V1 + 1/2 [o(y) — o(—2)). 
5. Other parent populations. 


A. Rectangular distribution. Let f(x) = 1/ (d — c), where c < x < d. Then 
§ = 4(c + d) ando;, = (c — d)*? / 4(2n + 1). Let H(x) be the cdf of ( — £) / on. 
If « > 0 and y > O, then lower bounds for H(y) — H(—z) are the right sides 
of (8) and (10), without the factors min {a(z,), a(y.)} and .9929. The upper 
bounds for H(y) — H(—z) are the right sides of (9) and (11) with an additional 
factor max {b(x,), b(yn)}, where b(x) is defined by 


2 2 
x . is SIL i 
2) = 4/2, =>0; ae eee em "StL 

We note that b(zx) is close to 1 only if z is close to 0, for example, b(.1) = 1.02 
and b(.2) = 1.05. This means that unless x and y are small, upper and lower 
bounds for H(y) — H(—z) are not very close to each other except for large n. 
B. Laplace distribution. Let f(z) = (1 / 2\) exp [— |x — &| /], where—o < 

xz < «, Then ¢ is the median and o, = \* / (2n + 1). Define c(z) by 


(12) 1—eé* =c(z) V1 — e, x>0. 


We say that c(x) S 1. If x 2 1, this is obvious; if z < 1, we use (7) to prove 
it. It then becomes clear that upper bounds for H(y) — H(—z) are the same as 
those corresponding to a normal parent population, that is (9) and (11). Lower 
bounds for H(y) — H(—z) are the right sides of (8) and (10) with min {a(z,), 
a(yn)} and .9929 replaced by min {c(z,), c(yn)}, where c(x) is defined by (12) 
and z, = x / ~/2n+ 1. Again we remark that c(zx) is close to 1 if x is small or 
large, for example, c(.1) = .99, c(.2) = .92, and c(3) = .97, while c(1) = .79 
and c(2) = .87. 

Finally we note that since c(x) tends to 1 asz tendsto0, H(y) — H(—z) tends 
to @(y) — @ (—2z) asn tends toinfinity. Therefore ( — £) / o, has an asymptoti- 
cally normal distribution. In the general theorem which showed that ( — £) / on 
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has an asymptotically normal distribution (see] 2], p. 369, also the beginning 
of Sec. 3), it is required that f’(t) be continuous. For a Laplace distribution, 
however, f’(~) does not exist. 
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SOME NEW TEST CRITERIA IN MULTIVARIATE ANALYSIS 
By K. C. S. Pruwar 


United Nations, New York, and University of Travancore, Trivandrum 


1. Summary. Three new test criteria are proposed for overall tests of hypothe- 
ses in multivariate analysis. They are based on the characteristic roots of certain 
matrices obtained from the product moment matrices of samples drawn from 
multivariate normal populations. The approximate distributions of the statistics 
involved in the tests are found as Type I or Type II Beta distributions. 


2. Introduction. In multivariate analysis, we generally wish to test three 
hypotheses, namely 

(I) that of equality of the dispersion matrices of two p-variate normal popu- 
lations, 

(II) that of equality of the p-dimensional mean vectors for / p-variate normal 
populations (which is mathematically identical with the general problem of 
multivariate analysis of variance of means); and 

(III) that of independence between a p-set and a g-set of variates in a (p + q)- 
variate normal population, with p S q. 

All tests proposed so far for these hypotheses have been shown to depend, 
when the hypotheses to be tested are true, only on the characteristic roots of 
matrices based on sample observations. For example, in case (I), all the tests 
proposed so far are based on the characteristic roots of the matrix S,(S; + S2)™’, 
where S; and S, denote the usual sum of product (S.P.) matrices and where 
both are almost everywhere positive definite (a.e. p.d.). Thus S:(S; + S:)~ 
is a.e., p.d., whence it follows that all the p characteristic roots are greater than 
zero and less than unity. In case (II), the matrix is S*(S* + S)~’, where S* 
denotes the “between” S.P. matrix of means weighted by the sample sizes and 
S denotes the ‘“‘within” S.P. matrix (pooled from the 8.P. matrices of | samples). 
Then S is a.e. p.d., and S* is at least positive semidefinite of rank s = min 
(p, l — 1). Thus, a.e., s of the characteristic roots are greater than zero and 
less than unity and the p — s remaining roots are zero. In case (III), the matrix 
is Si SiS Siz, where Sy is the S.P. matrix of the sample of observations on 
the p-set of variates, S.. that on the qg-set, and Sy, the S.P. matrix between 
the observations on the p-set and those on the q-set. If p S gandp + q < k, 
where k is the sample size, then a.e. the p characteristic roots of this matrix 
are greater than zero and less than unity. 

In each case, if the hypothesis to be tested is true, the s S p nonzero roots 
6,, where 0 < 6; S & S --- S 0, < 1, have the same joint distribution, the 
form of which was given by Roy [7], Hsu [3], and Fisher [1]. The distribution 


Received July 20, 1954. 
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can be written in the form 


(1) p(., --* , 0) = C(s, m, n,) I e7(1 — 0)" [] ©; — 0,), 


i>) 


0<4S8::> 


x? TL r}(2m + 2n +s +i + 2) 
i=l 


C(s, m,n) = = 


I] ry2m + i+ 1) PHQn +441) Th 


Here m and n are to be interpreted differently for the different situations. For 
example, in case (I), with n; and n2 as the sample sizes, 


(2) m=%3(m—p—2), n= 3(m-— p— 2). 

In case (II), with N the total of the sizes of / samples, 

(3) m=%(lI—p-—1|-1),, n=}(N-—I1—p-}). 
In case (III), 

(4) m=%#¢-p-1), n=3k-—p—q-—2). 


3. Current test criteria. The test criteria previously proposed for tests of 
hypotheses in multivariate analysis are mainly 

Hotelling’s Ti = ¢ >-i \;, where A; = 6,;/ (1 — 6;) and cc is a constant de- 
pending on the degrees of freedom of a matrix from which the characteristic 
roots were obtained [2]; 

Roy’s [8], [9], [10] criteria of the largest root 6,(A,) and the smallest root 
41(A1) ; 

Wilks’ [11] criterion, A = [][{(1 — 0,); and 

= or Di 6; ’ [4], (5). 

It is well known (see e.g., [9], [10]) that (i) the sample roots are invariant 
under certain classes of linear transformations, different for the different situa- 
tions discussed in the Introduction, and (ii) the joint distribution of these roots, 
when the hypothesis to be tested is true, involves as parameters only the so- 
called degrees of freedom, and, in addition, only a set of population roots (with 
a strong physical import) when the hypothesis to be tested is not true. 

It is likely that any statistic (and a test based on it), in order to possess these 
desirable properties, must be a function of these sample roots. All the tests 
proposed so far, including the ones proposed in this paper, are, in fact, based on 
functions of these roots and therefore have all the above properties. 

The choice of any specific function of the roots, as a basis for test criteria, has 
so far been made on additional considerations which are heuristic. The ultimate 
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justification is found in properties like (iii) usability in the sense of availability 
of large or small sample distribution of the statistic involved (on the null hy- 
pothesis) and (iv) some good operating characteristics of the test. Such charac- 
teristics are, for example, (iva) unbiassedness and (ivb) even something stronger, 
namely a power which is a monotonically increasing function of each of the 
deviation parameters, (ive) some good and convenient lower bound to the 
power, (ivd) possibility of getting, by inversion, suitable confidence interval 
statements, and (ive) admissibility. 

Hotelling’s T¢ has so far been studied and shown to be good under (i)—(iii). 
Wilks’ criterion has, as of moment, been shown to be good under (i)—(iii) and 
also under (iva)—(ivb), in so far as the criterion is to be used for situations (II) 
and (III) discussed in the Introduction. Roy’s criteria have so far been shown 
to be good under (i)—(iii) and (iva)—(ivd). The tests proposed in the present 
paper are also based on heuristic arguments, and are shown to be good under 


(i)—(iii). The further study of these tests in terms of (iva)—(ive) remains to 
be made. 


4. Three new test criteria. Wilks’ criterion is the sth power of a geometric 
mean, while 73 and V™ are s times the arithmetic means. This suggests the 


harmonic mean as another possibility. The following three criteria based on this 
statistic are offered. 


; ” (2 5 5 \-1 
Zz. (i —_ ay} : R® ce 82 5" : Tt a it ai" 


H® = + 
(i=l i=] ) \ t=1 
Before proceeding to derive the approximate distributions of these criteria, 
we may derive the approximate distribution of the criterion defined by W“ = 
1 — V/s, the tests based on which are exactly identical with those of V“”’. 
It has been shown [4], [5] that the distribution of V“ can be approximated by 
a Type I Beta distribution given by 


(5) p(v™) os wr oe ae 0O< vy <8, 


where C = 1 / s°@™*#*P9(15(2m + 8 + 1), 4$8(2n + 8 + 1)}. Hence it is 
easily seen that W“ has the approximate distribution 


(6) p(w) ai "ad | deed pe allie | st eye 0O< w” < 1, 


where C’ = 1/8{3s(2n + 8+ 1), 438(2m + s + 1)}. The approximate distri- 
bution (5) has been shown, [5], to be satisfactory for practical use for m + n 2 30 
when s = 2; when s increases by one unit, m + n must increase by 10 to give 
satisfactory results. Hence under these conditions (6) is also valid. 

Now we consider the criterion H“. If we put U® = T%/c, the approximate 


distribution of U“ has been shown [5], [6] to be a Type II Beta distribution of 
the form 


p(U™) as K{ uU = / [1 + py ee 
(7) 
0< U” < a, 
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where K = 1/s°°"***?g{4s(2m + 8 +1), sn + 1}. It may be seen that 
(8) U" = >= Devi — 0) = Da - 0) - 


i=] t=1 t=] 
Hence H® = (1 + U“/s)~, and use of this transformation in (7) gives 
p(H) = {A} — HO yen *P24 7 Bisn +1, $8(2m +8 + 1)}, 


0<H” <1. 

For this approximation to be valid it has been shown [5] that n + s must satisfy 
the conditions stated for m + n in the case of V. 

Again, to obtain the distribution of R“, if we make a transformation 6; = 

1 — 6;, fori = 1, 2, --- , s, the joint distribution of 6;’s resulting from (1) 

will have the same form as the joint distribution of 6,’s with m and n interchanged. 


Also we have 0 < 6, < --- < 6 < 1. Hence if we start with the distribution of 
6;’s, we obtain for 


(9) 


pe = dea — 6;) 


i=] 


the same form of approximate distribution as the one given by (7) with m and n 
interchanged. Now we consider 


(10) ye ) — "wares 


t=] 


Hence R“® = (1 + U’”/s)~, and with this transformation we have, as in (9) 


the approximate distribution of R® in the form 
an p(R) i (RO V" 1 — Rryertetan- 1 / B{sm 4 1, 439(2n he 8 + 1)}, 

0<R” <1. 
Here m + s must satisfy the conditions stated for m + n in the case of V“, 
for the validity of the approximation. 

It is interesting to note the parallelisms between the approximate distribu- 
tions of V“ and W“’, and between those of H“ and R. One is obtainable from 
the other by an interchange of m and n. It may be further noted that 
(12) ue = > = ia = 6; oe 

t=] i=l 
Hence 7” = R / (1 — R™), and from (11), the distribution of T can be 
obtained in the form 
p(T) 
(13) _ f rT oe 
Te fp TOAattetetDA+1 5 om + 1, 48(2n + « ‘ 1)}’ 


The approximate distribution p(T) also must satisfy the conditions stated 
for p(R) in (11). The condition that m must be large is more often suited to 
case (I) of the Introduction than to cases (II) and (III). 





eT? <0. 
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DISTRIBUTION OF DEFINITE AND OF INDEFINITE 
QUADRATIC FORMS 


By JoHN GURLAND 
Towa State College 


1. Summary. A previous paper [1] has given a method of approximating the 
distribution of a quadratic form in normally distributed variables by means of 
convergent Laguerrian expansions. In the case of an indefinite quadratic form, 
however, the method was restrictive in that it might be difficult to obtain the 
semi-moments required in computing the coefficients of the expansion. The 
present article circumvents this difficulty for positive values of the argument of 
the distribution function, when the number of positive or the number of negative 
eigenvalues is even, and also yields convergent expansions for the distribution 
function involving Laguerre polynomials. The proposed method has the further 
advantage that no moments or semi-moments need be calculated. 


2. Introduction. Suppose the random variable X = (X,, X:,--+- , Xn) has 
the probability density function 


(1) p(x) = (2x)*” |a\"*  exp(—420r’), 


where zQz’ is a positive definite quadratic form. It is required to find the distri- 
bution of XQX’, where Q is any n x n symmetric matrix. A linear transformation 
permits the problem to be posed as follows. Find the distribution function F(x) 
of > A,X? , where the \’s are real numbers and X has the probability density 
function 


(2) f(z) = (2n)-**  exp(—}zz’). 


A special case of this problem, with the X’s positive and satisfying the re- 
striction (in the above notation) 


(3) Mm <i DM, k=1,2,---,n, 
1 


was considered’ by Bhattacharya [2], who expressed the probability density as 
a convergent series in Laguerre polynomials. The present article employs a 
similar but more general method for expanding the cumulative distribution 
function, without restriction (3) and also without the restriction that all the 
’s be positive. 


3. Distribution of a positive-definite quadratic form. Suppose A; , Ax, --* , An 
are all positive, and set 


(4) 


Received October 17, 1953; revised August 2, 1954. 
' The author is grateful to L. Herbach for bringing this reference to his attention 
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where } is an arbitrary number satisfying the inequality 


\ > 4 max dj. 
The characteristic function of >>? \;X? may be written as 


g(t) = (1 — ois? T] (1 - ee): 
1 — 27Xt 


j=l 

Since 
1 — 21) >” dane oe 
for all values of t, (tf) may be expanded as the product of n power series. Thus 


wo 


(6) o(t) = D> a,(—2it)*(1 — 20h0)-**, 


k=0 


° ° ke . 
where a, is the coefficient of r° in the expansion 


Sater, p= Mod dst yy (a0) 


4 ; 
j=l i=l Lt: 1 


Explicitly, a, may be written as 
a, = Bx Lai + Bes Bid 20k a; + Br-2 Bod dat a} 
i= i<j i<j 
+ Bre BidU eta; ar + Br Be Brody da, a5 artic. 


i<j<l i<i<l 


(7) 


% = 1, a = fi Dias, a = bs Lai + Bia, 


a; = Bs Dai + bs Bd dai a;+ SLD da 0; ny 
iss) iy*) 
and so on. Application of the inversion formula [3] 


(8) Fiapie bw a ¢ ole a, 


2 (at t 


noting that the series in (6) is uniformly convergent for all values of t, yields 


0 — 957)" PO “F g\—n/2—k 

i a) wi Med ¢! 2it)*(1 — 2idt) oe a 
2 TL kad t 

These integrals may be evaluated by use of the following identity in x, obtained 

by applying the inversion formula (8) to the characteristic function of a x’ 

distribution with 2k + n degrees of freedom. 


—2iite — Osh 4) 82-* 
1 1 f ee — 2h 1 


22 
ai n/2+k—1 —v/2 : 
2 Dwi. t 2n/2+kD(n/2 + k) [ - ou & 
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This is differentiated k times, yielding 
~\k r ¢__99\k — Oey p)~ 2/2 k 2 thee k-1 
(X) (—2it)"(1 2iAt) é aw T(n/2 + k) £) enzyttte ~ 
—2ri t dx 


which is valid for k = 1 and for all values of x = 0, since the integral on the 
left side converges uniformly. But from the theory of Laguerre polynomials [4] 


(9) ($y ex” = mie *x"L"(z), ae? 


i (— 2it)* a ab Qnty? *¢ —2idtr an cas r'(k) ex peg 40°) 
Qni t r(k + n/2) G 


and the distribution function of >: \,X; may be written 


1 a/h ates ol r'(k) = 2h n/ id Pai C7, 2i) 
(x) = Dn 2”? T(n/2) I v dv + p> ax T(k + n/2) Qni2) beni? 


ze = 6. 


It is, of course, evident that a similar argument can be used to obtain an anal- 
ogous expression for the probability density, F’(z). 


4. The difference of two independent x’ random variables. Before considering 
the distribution of an indefinite quadratic form in the next section, it is necessary 
to refer to the distribution of a difference of two independent x’ random variables. 
Let X and Y have the probability density function 


p(a, y) in (1/eje COR et z> 0, y> 0, 


where c = 2%'*/?1(¢,/2)1(f2/2). The joint probability density function of Y 
and V = X — Y is 


(1/c)e"? *(y + vty?" oy > 0, v+y>0. 


If it is assumed that f, is an even integer, say 2m, then we may apply the binomial 
expansion and integrate out y to obtain the probability density of V. 


FEC a )ratgbow 
'C hed 2 


me) J 
2 > (" ') carted etyh tia dy 
h=0 v 


0 1 
let K = [ p(v) dv = [1/B(fi/2, fo/2)] | (1 — w)?w!!** dw, which is 
— 26 1/2 


available from tables of the incomplete Beta function. Now we apply inversion 
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formula (8) to the density p(v) to obtain 


1 eit dt 
2 Qni Uta (1 — mG + — 2ine7(1 + ine)?” t 


(10) | K +- p> 5 ' rat 1/0) | tinea 


) ['e —v/2 rt 1—h a | e¥ * eit dy, x 


First, in the case x = 0, the kth derivative with respect to x of (10) yields 


at eth _ oasis)" dt 
Qei J (1 — 2int)*7(1 + int)?” t 


(12) 
re as +e Ars h ') 2” "T(h + fo/2)e °K Os bmls k2= l, x 0 


C hao : 


where K,,,(x) is a polynomial of degree p defined by (d/dz)*e “x” = e*K,,,(x) 
From the definition of Laguerre polynomials (cf. (9) above), tie K-polynomials 
have the relation? to Laguerre polynomials 

Ky.o(x) = giz” “Ly? (2), p-q>-l 


The restriction p — q > —1 is no drawback, however, since z*K,,,(r) = 
x” Ky,p(2). 


Now, in the case x S 0, we assume that f, is an even integer, 2m’ say. Before 
differentiating (11) we note that 


2z « « 
iif geht dv [ ett" ay} ai e*(2r)"*" [ apentre dy, 
D ~ py 22 


and define J,,,(x) by (a/dz)* [ ey” dy = e*J>y,.(x). (Forg 21, Jp,isa 


thy; of degree p.) Then the kth derivative of (11) can be written as 


-¢ ee eo = (O551)* dt 
(1 — 2zxt) _ (1 — 2ine?7(01 + ine’??? tt 


—1\$[(/k -1\ pe . 
eis) game are as B 


The J-polynomials are related to the K-polynomials (and hence to the Laguerre 
polynomials) by 


Jp.a(t) = (—2)?e* ¥ _ dee (? S ') K,,,(x). 


s=0 


(13) 


2 This relation was kindly pointed out to the author by the referee. 
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5. Distribution of an indefinite quadratic form. Suppose 


ni+Ne 


XQX’ =D AUXI- D AX, 
1 nit+l 
where \; > Ofori = 1, 2,---,n,andn = n, + nme. We may assume that X 
has the probability density f(x) of (2). Define a; and } as in (4) and (5), respec- 
tively. Then the characteristic function ¢(¢) of XQX’ can be written as 


«=o \—n3/ ss ni Pita; —1/2 nitne ( Dita, ” 

1 — 2iy "(1 + 2icky™*"* TT (1 -— i.) 1 a). 
(1 = aay" + aad? Th (1 - Oe ET (1 + Pile 
As in Section 3, this may be expanded as a product of n power series to give 


g(t) = > > a; by f- —2it)’ (1 - ith) *"?-*(2it)* (1 a 2ith)”? /2—k+j 


k=O j=0 
which is uniformly convergent for all values of ¢. Here a; is expressible as in (7) 
with n; replacing n. Analogously, b, may be expressed as 


ni+ne 


b, = By ~ ai + Biahi DL Dat ‘a; + Bra 2 2 at ‘aj + 


t=—n)+1 i<j i<j 


fori=m+1, m+2,---, m+mandj=m+1, m+2,---, m+tm. 
Applying the inversion formula (8), the distribution function may be written 


F(z) = 57 5 LES (= 1) labs; ta az (2it)“e" *** dt 


— Dit) *1!2+7(] + Qith)*2/2+*-a 


k=O j=0 


In virtue of (12) this becomes, for x = 0 


, 


m—1 z/d 
F(z) = K+ : > re y ') r (1 +%) , eas 
C hmd a 


“0 


pSOBPS:- 17" 4,55* Pas h ') 


k=1 j=0 h=0 


li x 
mr (x+%) Kove v(2) 
2 ( + m) K 1h, k—-1 95.) 
where n, is an even integer, say 2m. 
For z < 0, (13) is applied, with ne = 2m’, to give 


F(z) = E 7 ei = af. cape dv [ Pare dy 
e7! (2h o k ne ee a 1 k ¢ : 
- 2 a {— 1)***a;be_;X x“ a mu <; ) ( ) 


k—1 j=0 h=w0 r=0 r 


> x x 
5 } ae k—l—r (=) J him’-1, r ( 
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The additional assumption n. = 2m’, stated above, is needed here only for the 
purpose of evaluating 


—az/r oo 
—z/2 m—1—h h+m’—1 
[ Te, av [ ey” dy =I, 
C) —y 


By change of variables we may write 


—z/i « 
—v/2 —1—h —(z— h+m'+1 
r=[ ev" dy | & (2 — vi dz 
2 “0 


t—0 t 


h+m’—1 oe —z/X 
- -. (—1)° (‘ = ‘) r(h + m’ — 2) [ ey dy. 


This can now be evaluated with the aid of tables of the incomplete Gamma 
function. 


6. Conclusion. Although the distribution function of a positive definite 
quadratic form is approximated by a relatively simple Laguerrian expansion, 
the distribution of an indefinite quadratic form gives rise to a more complicated 
expansion involving Laguerre polynomials. This is, of course, due mainly to 
the fact that the weight function corresponding to the orthogonal system of 
Laguerre polynomials is zero for negative values of the argument. On the other 
hand, Gram-Charlier series, although convenient for asymptotic expansion 
theory, do not converge for a sufficiently wide class of distribution functions 
(ef (1]). 

The present article has dealt essentially with the question of convergence, 
and has shown how to construct a series involving Laguerre polynomials which 
actually converges to the distribution function. An important question not 
considered in this paper is how rapidly these Laguerrian expansions converge. 
Some results along these line are now being prepared for publication. 
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NOTE ON THE DISTRIBUTION OF A DEFINITE 
QUADRATIC FORM!:?: 


By JAMES PACHARES 


Naval Air Missile Test Center, Point Mugu, California 


1. Summary. An expression is derived for the distribution of a definite quad- 
ratic form in independent N(0, 1) variates which depends only on the value of 
the determinant of the form and on the moments of a quadratic form whose 
matrix is the inverse of the original quadratic form. This expression is an alter- 
nating series which converges absolutely and is such that if we stop with any 
even power of the series we have an upper bound and if we stop with any odd 
power of the series a lower bound to the cumulative distribution function. The 
result given in this note seems to be in several ways an improvement over the 
method given in Robbins [2]. 


2. Notation. All vectors are column vectors and primes indicate their trans- 
poses. Thus X’ = [X,, --- , X,]. In addition dz, stands for dx, --- dz, , while 
|A| stands for the product a; --- a, where a,,---, a, are the latent roots of 
the matrix A, and E(Q,)* stands for the kth moment of Q, . 


3. The problem. Suppose we have a quadratic form Q, = }Y’AY in 
Y:,°°:, Ya where the Y; are independent N(0, 1) variates, and where A de- 


notes a definite n x n matrix. It is well known that we can make an orthogonal 
transformation reducing Q, to its canonical form, that is Q, = 1>> a,X? where 
the elements a; , --- , a, are the latent roots of the matrix A. Under such a 
transformation, X,,--- , X, remain independent N(O, 1). Let F,(t) = Pr- 
(Q, & t), then the problem is to find F,(t). 


4. The solution. 
TuEorem. Let Q, = }>_1 a:Xi , where the X; are independent N(0, 1) variates 
and where a; > 0 fori = 1,2, --- ,n. Let QF = 30! ay Xi. Then 


6 (BQ 
(®) FO = Tana get Gn +E FD: 
(b) the series in (a) is absolutely convergent; 
(c) for any two nonnegative integers r and s and every t > 0, 


2r+1 


Sn = Dd > Filt) > Do dy = Songs, 
k=O k=0 
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ao 2. Ma. 2 
* [AP2 kD Tan +k +1)" 
Proor. Let [R] represent the region where $>>‘ agai < t. Then 


(1) F(t) = (24)"” / vee / exp | — 4 Dat | ae 
{R) 


Expanding the exponential in the integrand, we get 


Fa) = yf - [ER(-3 Sat) den. 
[R] 


Toevaluate integrals like [- -f (>> f27)* dz,, we expand the integrand accord- 


[R] 
ing to the multinomial theorem and get 


1+: 2, a! =o a 


We shall make use of the Dirichlet integral 


[o> [TL as, = Ir (4) ¢ i]t [> wey +1], ~x <%<@, 


where 1; , c; , and p; are all positive and the integration is over the region where 
>"? (xi/e:)”* < 1. (See Edwards [1].) Putting 


cy = (2t/a;)'”, lee 2, l; 5 a 21; + 1, 
we find that 


or) a” sees Tis + 3) «+ Tn + 4) 
| oe | (x t') des = iT Gn FETT) oa hee Gl Gla ah 
R 


The problem now is to evaluate this last expression. Recalling that if X,;is N (0, 1), 
then E(3Xi)* = T(k + 4) / (3), we find that 


n k 
B(Q*)' = E € a;*Xi) 
1 


ki Xj" --- Xa 


nes r 
bit-> <= tbgeall lle tn! aj'--- 


=2°“E 


a in 


a i oa Ma + 3): - Ti, + +) 


$s} --4pdyenk il +---d.] aji -++ ain 
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Consequently 


(2) / e | (= iol mr |A am rt 7 1) B(Qs)’, 


Md (—0)* E(Q*)* 
Flt) = | aya a KL P@n+k+1) 
This proves part (a) of the theorem. 
To show absolute convergence for part (b) we note that if a = min a;, then 


, #k & T'(4n + k) 
Q: s5 => Xi, BQ)" s Gy 
Thus if F';(¢) is the sum of the absolute values of the terms of the series for F,,(t), 
then 


- 


= T(jn + k) 
F(t) s rE he Fi ki a’T (4n)P(4n +k+t + 1) 


{"!? 


el 
— mip’ <* \t| < o, 


This proves part (b) of the aoe 
The bounds of part (c) are based on the fact that if r and s are any two non- 
negative integers, then, for ¢ > 0 . Taylor wee <— 


1 ( 


a ee oh ee 


k=0 k=0 


Replacing ¢ by > zi and using ‘a and (2) then proves part (c) of the theorem. 

REMARKS. (i) In case some of the latent roots are zero, that is the form is 
positive semidefinite of rank r, say, we need only replace n by r in the theorem 
and in the proof. (ii) The moments of Q* are easy to obtain from the cumulants 
of Q% . The rth cumulant of Q? is $(r — 1)! }? ay” forr = 1,2, --- . (iii) Clearly 
So, Sz, Ss, --* is a sequence of upper bounds and S,, S;, S;, --- a sequence 
of lower bounds for F,,(¢). In practice we would compute a finite number of terms 
and then state that min S,, > F(t) > max S2,; . The absolute value of the error 
thus committed is not greater than min S,, — max S:2,,; , where r and s are non- 
negative integers. 


5. Application to the distribution of a sum of squares in dependent variates. 
Let Xi, --- , X, have a joint multivariate normal distribution with zero means 
and inverse covariance matrix A. We wish to find the distribution of R = 
4 X’X. Now 


Pr(R st) = 7 - f exp[-42’ Az] dz,,. 


(2 
[iz’2st] 


We make an orthogonal transformation such that 


|A|*” | - Pe | 
Pr(R < di. ~ en | - [ exp DL avi dy, , 


(4u’vst) 
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where a, --- , a, are the latent roots of the matrix A. We now let z; = 
getting 


Pr (R s t) = (2x) ”” / ee [ exp [—4z'z] dz, , D = E > a2 < 
1 
D 


Pr(Qi <2). 


Thus we can make use of the theorem. 

ReMARK. Combining the results of the theorem and the above application, 
it is easy to show that we could find the distribution of a definite quadratic form 
X’AX where X,, --- , X, have a multivariate normal distribution with covari- 
ance matrix B™, which distribution involves as parameters the latent roots of 
AB" 

We shall now state, without proof, an obvious corollary to the theorem, ob- 
tained by letting the first m; latent roots be a, , the next mz: latent roots be az, 
etc. 

Corouuary. Let S, = }(@ixn, + °°: + Grxm,), where the xn,, for i = 1, 

-+ ,1r, are independent random variables having a central chi square distribution 
with m; degrees of freedom. Let 


S* = Raz'x2, + --- + a;'x3,), 
M = , of a;>0, Gt) = Pr(S, < 2). 
1 


Then 

bin > 0 vnaehie Po: | BURP. 

(ay! --- arr)? kt T4M+k+1)’ 

(b) The series in (a) is absolutely convergent; 

(c) For any two nonnegative integers s and j and every t > 0, 


Qs 2)+1 : a (—t)* E(S*)* _ 
2d ds > Gt) > dX dx, = (at' --- amr)? kt TAM +k+1)' 


Remark. The moments of S? are easy to compute from the cumulants. The 
jth cumulant of S? is 3(j — 1)! Ct-vm,az’. 


(a) G,(t) = 
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ON THE MAXIMUM NUMBER OF CONSTRAINTS OF AN 
ORTHOGONAL ARRAY’! 


By EstHEeR SEIDEN 
University of Chicago 


1. Summary. R. C. Bose and K. A. Bush [1] showed how to make use of the 
maximum number of points, no three of which are collinear, in finite projective 
spaces for the construction of orthogonal arrays. In particular this enabled 
them to construct an orthogonal array (81, 10, 3, 3). They proved on the other 
hand that, in the case considered, the maximum number of constraints does not 
exceed 12 [1], (Theorem 2C). Hence they state: ““‘We do not know whether we 
can get 11 or 12 constraints in any other way.” 

This paper shows first that a 10-rowed orthogonal array, constructed by the 
geometrical method, cannot be extended to an 11-rowed orthogonal array. It 
then shows that the number of constraints does not exceed 11. The problem of 
construction of an orthogonal array with 11 constraints remains unsolved. 

This summary should serve, as well, as a correction to the statement made in 
the abstract, “‘A remark on the geometrical method of construction of an orthog- 
onal array,”’ published in the Annals of Mathematical Statistics, Vol. 25 (1954), 
p. 177-178, which claimed the nonexistence of an orthogonal array of 11 con- 
straints also. 


2. Introduction. The proof is based on an algebraic property of orthogonal 
arrays, pointed out by Bose and Bush [1]. Let nj; denote the number of columns 
belonging to an array consisting of k rows that have j coincidences (j elements 
equal) with the ith column. A necessary condition for an array (As‘, k, s, t) to 
be orthogonal is that whatever be the number A such that 0 S h & t, the follow- 
ing equalities hold 


k 
D ni; Ch = Ci (as — 1), i = 1,2, ---,As' 
j7=0 


where the C’s are binomial coefficients. 
In the case considered, the equalities become, for i = 1, 2, --- , 81, 


k k 
do Mi 80 2X ij — 1) ni; = 8k(k — 1) 
ye j= 


(1) 


Dini = 26k — DL jlj — MG — 2) wy = Bk — 1k — 2). 


j=0 
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Equations (1) will be used throughout the proof in the special case of i = 1. 
Moreover, it will be assumed, without loss of generality, that the first column 
consists of zeros only. 


3. Derivations. 

Lemma 1. An orthogonal array (81, 10, 3, 3), with 10 constraints and ni} = 0 
for j = 5 cannot be extended to an 11-rowed orthogonal array. 

Proor. The third and fourth equations of (1) becomes in this case 


oni? + 6nio = 720 — 12ni8 
6ni$ = 1440 — 24n}%. 


Since nj; = 0 and nj = 0, both equations imply ni; < 60. On the other hand, 
subtracting the second equation from the first gives ni; = 60. Consequently 
nis = 60 and niz = nig = 0. Then the second and first equations of (1) imply 
ni; = 20 and nie = 0, respectively. It remains to show now that an array satisfy- 
ing this solution cannot be extended to an 11-rowed orthogonal array. We ob- 
serve first that this solution implies nj} = nj; = 0 and thus all other n’s are 
uniquely determined, namely nis = 9, niu = 60, nis = —10, ni; = 21, 
which is clearly impossible. 

THEOREM 1. A 10-rowed orthogonal array constructed by the method employed 
by Bose and Bush [1] cannot be extended to an 11-rowed orthogonal array. 

Proor. Since the maximum number of points of which no three are collinear 
in the projective plane considered is equal to four, it is easy to see that the 
method of construction cannot lead to a column having more than four coin- 
cidences with the first column. Hence the theorem is an immediate consequence 
of Lemma 1. 

LemMMA 2. The number of coincidences between any two columns of a 6-rowed 
orthogonal array 1s less than six, provided that) = s = t = 3. 

Proor. Consider equations (1) fork = 6 and i = 1. Express * ae 
and n}; in terms of ny, nis, and nis. The equations become 


nio = 4 + nig + 4nis + 10m, ni; = 36 — 4ni, — 15ni, — 36n%, 


6 a ail se 6 6 6 nit 
Nyo = Gnyg + 2ONi5s + 45716, Nig = 40 — 4nyy — 1015 — 206. 


If n's > 0, all the n’s are uniquely determined, namely 


6 6 6 6 ‘ 6 - 6 6 
neg = a Nig = Nya = 0, ni3 = 20, rio = 45, ni = 0, nio = 14. 


This means that every 4-rowed subarray must satisfy the equality nj, = 1, and 
again all n’s will be uniquely determined as nj; = 4, ni. = 30, ni; = 28, and 
nio = 17. Hence, if we delete from the original array any two rows, the number 
of columns which have no coincidences with the first column will increase by 
three. Since n{, = 0, every pair of rows will contain exactly six zeros, contained 
in three columns each having two zeros. Moreover, different pairs must contain 
zeros belonging to different such columns. The number of pairs of rows is equal to 
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20. Hence nj: would have to be equal to 60, contrary to the assumption that 
niz = 45. This proves Lemma 2. 

Corotitary. Any orthogonal array (81, k, 3, 3) satisfies the equalities n‘; = 0, 
provided that] 2 6and1 Si S 81. 

Lemma 3. An orthogonal array with 11 constraints satisfies one of the nine 
solutions 


Solution 
n 


is 


I il 
II 12 52 
Ill 13 49 
IV 13 
V 14 45 
VI 14 46 
Vil 15 42 i2 
Vill 16 39 14 
IX 17 35 20 


Proor. In view of Lemma 2, equations (1) imply 


9,11 ll ll ll 9,11 11 
2ni2 + 3n43 = —110 “+ 10ni5 ’ 311 + 2ni0 = 88 — 5nis5 . 
ll : . ° ° 
Hence, 11 S nis S 17, since all the n’s are nonnegative. All solutions which 
could be satisfied by an orthogonal array with 11 constraints can now be easily 


. ll ll 1l ll - ll 
enumerated. For instance, we may express njo , 11, %i2, and nj3 in terms of nj, 
ll 
and nj;. Then 


11 11 11 11 > 11 ~ il 
nio = — 96 + Ni4 + 4nis, ni = 396 — 4nis —- 15745 , 


niz = —550 + 6nig + 20ni5 , niz = 330 — 4nii — 10ni5. 


Consider now, for example, nis = 11. By the last equality, ni; S 55, and by the 


° : 11 -~ ll ~~ ° 
third equality, nig 2 55. Hence nj, = 55 and all other n’s are uniquely deter- 
mined. 


Lema 4. If an orthogonal array of 12 constraints exists, it must satisfy one of 
the two solutions 


Solution 





2 


i, 


x : 42 
Il’ 8 39 


Proor. Equations (1) imply for k = 12 
3nis + 2niz = —264 + 10nif, 3nii + 2niz = 144 — 5nik. 
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Thus 27 S nis < 28. The same method as before shows that I’ and II’ are the only 
solutions of equations (1) for k = 12 and nig = 27 or nig = 28. 

THEOREM 2. The number of constraints of an orthogonal array does not exceed 11, 
provided that) = s = t = 3. 

Proor. It is enough to prove that neither Solution I’ nor II’ can be satisfied 
by an orthogonal array. As to solution I’, since nj¢ = 6, every 11-rowed subarray 
would have to satisfy the inequality nio = 6. Hence it remains to consider solu- 
tions IV, VI, VII, VIII and IX. It is easy to rule out all except VII since the rest 
could lead to 12-rowed arrays for which, if nig = 6, nii could be at most equal 
to two, contrary to the assumption that it is three. Hence, every 11-rowed sub- 
array of an array satisfying I’ would have to satisfy VII. This is impossible, 
since ni; ~ 0. Thus, if we delete from the array a row which contains a zero be- 
longing to a column having just one zero, we must get an 11-rowed subarray for 
which nip = 7. 

The proof regarding solution II’ is analogous. Here every 11-rowed subarray 
would have to satisfy either VIII or [X. Solution IX is impossible, since it 
could lead to a 12-rowed array for which, if niz = 7, iz is at most equal to one. 
As before, it is impossible that every 11-rowed subarray of an array satisfying IT’ 
will satisfy IX, because deletion from this array of a row containing a zero 
belonging to a column which has two zeros only must yield an 11-rowed subarray 
for which nj; > 0. This completes the proof of Theorem 2. 

It is easy to show that no 1l-rowed orthogonal arrays exist which satisfy 
solutions II, III, or V. As to the remaining solutions, the problem is unsolved. 

I wish to thank R. C. Bose for making accessible to me his unpublished work 


on this subject. 
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NOTES 


ON A SEQUENTIAL TEST FOR THE GENERAL LINEAR HYPOTHESIS! 
By Paut G. Hort 
University of California, Los Angeles 


1. Introduction. A few years ago I reported [1] on a sequential method for 
testing the general linear hypothesis, but held up publication until some of the 
properties of the method had been investigated further. Johnson [2] recently 
published a paper in which he obtained the same sequential test, but from an 
entirely different point of view. His method of derivation is based on showing, by 
means of a theorem of Cox [3], that the likelihood ratio approach to the problem 
can be used successfully. My method is a direct generalization of Wald’s sequen- 
tial t-test. This note outlines the nature of this generalization, and also points 
out some additional properties of the test. 


2. Method. The general linear hypothesis assumes that the variables 2, , 
t2,°** , 2%, With means mw, we, --* , #4; and common variance o possess the fre- 
quency function 


k l 
(1) fla, «++, 2.) = (2c) exp = | (c;— p+ DY ai}. 
Co i=] =k+1 J 
It tests the hypothesis Hp: yw, = --- = wp = 0, for p S k. The means 
Mks1,°** , #2 have the value zero. The parameters yy41,-°°* , ue, and o are 
nuisance parameters, and therefore make Hy a composite hypothesis. 

Following Wald’s [4] procedure and notation for the sequential ¢-test, let 
the parameter space 2 be divided into the three regions w, , w, , and Q — we — w,. 
The region w, will be chosen as that part of 2 where H, holds. The region w, will 
be chosen as that part of 2 where 


zr 


im] O 


where po is a selected constant. The boundary of w, will be denoted by S,. As 
normalized weight functions choose 
by /< —k ° 
[a, 0" (2c)”™, ¢, |u| Sc,i=ptl,::-, 
v6) = | 


0 : elsewhere; 


k, 


\ 
(ae o” (2c)? 5 Cc, |i L Pp + l, oe k, 


v0) = 
{ 0 , elsewhere. 


Received February 19, 1954. 
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Here a, , a2, b;, and by are certain related constants to be specified later. With 
these weight functions and with [[*:f(aie, --* , 21a) denoting the likelihood 
function for a sample of size n from (1), form the quantities 


Pine = [ 
8, 
Pore = [ 


Here S,. is that part of the surface S, and w,. is that part of the region w, where 
0 < o Scand |p| S cforit = p+ 1, --- , k. These are truncations of S, and 
wa to permit the existence of the necessary integrals. 

Now choose bs = b; + 1 — p, form the ratio Pine / Pone , and allow c to become 
infinite. The resulting limit, which will be denoted by pin / pon , is then treated 
as the likehood ratio in the standard sequential probability ratio test. By choos- 
ing b} = —1 andl = k it can be shown that this test reduces to the test proposed 
by Johnson. 

The procedure, in outline, for obtaining the reduced form of this test is as fol- 
lows. The numerator integral in pin / Pon, Which is a surface integral over S, , 
is expressed as an integral over the 41,---,H» plane, and the denominator 
integral is expressed as an integral with respect to o. Then, letting 


vy (8) I f(212, oy Lia) dsS,. 9 


000) TT f (ries +++ 5 210) a 


a 


(ie, i=1,---,pk+1,---,1, 
\tia — 4, t+=pt+il,::-,k, 


Zice = 


it is shown that pin / Pon is a homogeneous function of degree zero in the z;.. 
This permits the replacing of zie by Zia / vey zt, Which in turn enables one 
to evaluate the denominator integral. The numerator integral is evaluated by 
introducing spherical coordinates, expanding one of the exponential functions 
in the integral, and integrating term by term. The resulting series will be found 


to reduce to a confluent hypergeometric function. The result of these manipula- 
tions is the expression 


(2) - = ¢™*!? F(nl + p — k — by — I], 3p, 8°/2d0) 
‘On 
where 8° = nda n >,?; £2 / + uitie — 2 di Zi] . 

This derivation requires that b; S 0. If b; is chosen equal to —1, the preceding 
test reduces to the Johnson test except for one minor feature. Johnson’s formula- 
tion of the general linear hypothesis does not include the variables 441, --- , 21, 
and as a result our first parameter values in the confluent hypergeometric func- 
tion are not in agreement unless 1 = k. His derivation applies equally well to the 
formulation given in (1), and then his test will be identical with (2) for b; = —1. 
The choice of b} = —1 in (2) is probably as good a choice as any other. 


3. Properties. If the principle of invariance is applied, the sequential test (2) 
will possess an interesting property. 
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From (1) the frequency function for a sample of size n is 
l 
(3) = (29c)~ pm exp yp ae (tia — ui)” + : y ata} 
imk+ 


By an orthogonal transformation for which ta = (ta tees + tn) / VV n, 
fori = 1, --- , k, (3) can be reduced to the canonical form 


(4) L' = (240) ™' ena [2 ry + > > zi + > (an - Vn uo] 


a=2 i=] a=] i=k+1 


From this it follows that the problem specification will remain invariant under 
the following groups of transformations: 


(i) Za = tate, fori = p+ 1, ake ies 


, Gi) any orthogonal transformation on the variables z;. when the variables 
Zu yet 1 Tin are deleted, and any orthogonal transformation on the variables 
/ 
Ti,** » Bon ; ; 


(iii) Zia = Ctia, fori = 1,--- ,lhanda=1,---,n. 


Standard methods will show that the maximal invariant under these groups 
of transformations is 


= Dat /[Z > 2 +> > xis | 


i=_1 a=2 i=l a=1 imk+1 


In terms of the original variables z;. , the expression for ¢, reduces to 


Pp n l k 
anda /[L Ua nd atl 
i=1 a=] i=] t=p+l 
Thus, if the test of Hy is to be an invariant sequential test, it must be based 
on the sequence of variables ¢; , ¢2 , 3 , --- . Since (2) is based on this sequence, 
it is an invariant test. The distribution of ¢, depends on the parameters through 
the single parameter 


pi 
cope. 
i=] 0~ 


As a consequence, for any invariant test, testing the hypotheses 
, 
Ho: ui = 0 vs. Ay iui = wi, 


is equivalent to testing the hypothesis \ = 0 against the alternative \ 
where hy = >.?u.’ / 0’. 

Johnson has shown that test (2) is the probability ratio test for testing \ = 0 
against ) = > based on the variables ¢ , ¢:, ¢;, °-- . If the latter variables 
were independent, it would follow from the optimum property of the proba- 
bility ratio test that test (2) with b;} = —1 is the optimum invariant test of He. 
However, since these variables are not independent, this conclusion does not 
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follow. It may be that the use of decision limits which depend upon the value of 

n will produce a better test than (2), which uses the customary constant limits 

for the sequential probability ratio test. 
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TWO COMMENTS ON “SUFFICIENCY AND STATISTICAL 
DECISION FUNCTIONS” 


By R. R. Banapur anp E. L. LEHMANN 
Columbia University and University of California, Berkeley 


In the following comments we employ the notation and definitions of [1]. 
The first comment answers a question raised in [1] by giving an example of a 
necessary and sufficient subfield which cannot be induced by a statistic. The 
second remark clarifies this example somewhat by discussing the connection 
between statistics and subfields in general. It was hoped that this connection 
would be so close as to provide the answer to another question raised in [1]: 
whether the existence of a necessary and sufficient subfield implies that of a 
necessary and sufficient statistic. However, an example given at the end of the 
second comment shows that sucha result cannot be proved without making deeper 
use of sufficiency. 


1. A counter example. The following result was communicated to us by 
David Blackwell. 

Lemma 1. (Blackwell). Let So be a proper subfield of S and suppose that for 
each x the set {x} consisting of the single point x is in So . Then So cannot be induced 
by a statistic. 

Proor. Suppose there exists such a statistic, say 7’, and let T be the field of 
sets B in the range of T such that T”*(B) e S. Since {x} ¢ Sp , there exists B e T 
such that 7” '(B) = {x}, and, by definition of T, aset A ¢ S such that T(A) = B. 
We therefore have T“[T(A)] = {x}, and since always T'[T(A)] D A, we 
have that 7 “[7'(x)] = x for all x. Therefore, if A is any set in S, we see that 
T '[T(A)| = Aso that A e So and hence our assumption that Sp is induced by T 
implies that So = S. 

We now give an example of a necessary and sufficient subfield that cannot be 
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induced by a statistic. A trivial such example would be the case of two normal 
distributions defined over the Lebesgue sets S of the real line. Then Sy , the class 
of Borel sets, is a necessary and sufficient subfield, and this cannot, by Lemma 1, 
be induced by a statistic. The example is, however, uninteresting since S) = 
S[S, P] and §S is induced by the necessary and sufficient statistic T(x) = z. 
In this case, therefore, the necessary and sufficient statistic is equivalent to the 
necessary and sufficient subfield. 

An example in which this is not the case can be based on a problem discussed 
by Halmos ((2], p. 71, prob. 2). Let X be the interval (0, 1), let So be the class 
of Lebesgue sets of X, and let p denote Lebesgue measure on S,. Let M C X 
be a fixed set which is not Lebesgue-measurable, and let the complement of M 
be denoted by M. Define S to be the class of all sets of the form EM + FM, 
with E and F in S . Then § is a field containing S) . We take (X, S) to be the 
sample space. To define P, let G and H be fixed sets in So such that 


GCM C H and p(@) = ps(M), p*(M) = p(A), 


where ps and p* denote inner and outer Lebesgue measure. Let D = H — G, 
and for any set N = EM + FM in S define 


(N) = p[(EM + FM)D) + 4p(ED) + 4p(FD). 


Halmos shows that \ is a measure on S such that A = pon S_. Let the set P of 
probability measures on S consist of the two measures \ and y, where u is defined 
by du = 2x dh. 

It is easily seen that in this case (i) So is a necessary and sufficient subfield 
(ef. Theorem 6.2 of [1]), (ii) To(x) = a is a necessary and sufficient statistic 
(cf. Theorem 6.3 of [3]), and (iii) P is a completed set of measures on §, that is, 
if a set A is S-P-null, then every B C A isin S (and therefore S-P-null). We shall 
show that no necessary and sufficient subfield is equivalent to a statistic; a 
fortiori, no such subfield is inducible by a statistic. 

Suppose to the contrary that S, is a necessary and sufficient subfield, and that 
S. = S,[S, P], where S; is the subfield induced by a statistic 7. It follows from 
the essential uniqueness of the necessary and sufficient subfield (cf. Corollary 6.2 
of [1]) that S, is necessary and sufficient. Consequently, by (i), Sr is equivalent 
to So . The sufficiency of S; means that T is a sufficient statistic. Hence, by (ii), 
T» is essentially a function of T. More precisely, there exists a function F on the 
range of T into X, and an S-P-null set N, such that To(z) = F(T(x)) on X — N. 
This, together with (iii), implies that the subfield induced by T> is essentially a 
subfield of S; . However, 7) induces S itself, so that S, must be equivalent to S. 

Thus Sr is equivalent to Sp and also to S. We conclude that S» is equivalent 
to S, that is, S) = S[S, P]. Since M is in S, and P contains \, this conclusion 
implies that there exists a set in Sp , Ey say, such that the symmetric difference 
of Ey and M is of \-measure zero. This is, however, a contradiction, since the 
symmetric difference in question is HM + E,)M, and its \-measure is not less 
than 4p(E.D) + 4p(E.D) = 4p(D), and p(D) = p*(M) — px(M) > 0. 
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2. The connection between subfields and statistics. The above Lemma of 
Blackwell provides a necessary condition for a subfield to be inducible by a 
statistic. We shall now obtain a necessary and sufficient condition. As is pointed 
out in [1], any subfield S, of S induces a partition if we put z ~ 2’, provided 
for all Ay ¢ Sp we have x € Ap = 2’ € Ay . Let E, denote the set of x containing z. 
Then we may characterize E, as the largest set containing z and such that for 
all Ao € Sp either E, © Ao or E, © Ao. 

Not every partition z can be induced by a subfield of S, and if it can there may 
be more than one subfield inducing it. Let us denote by C, the (possibly empty) 
class of all subfields of S that induce x. We then have 

Lemma 2. If C, is nonempty, it contains a largest member S, which is given by 


S, = {A:AeS,zeA> EF, CA forallze X}. 


Proor. Since C, is nonempty, there exists a subfield S; of S which induces z. 
For any A; ¢ S; and any z ¢ X it follows that z ¢ A, => E, © Ai sothat S$: CS, . 
Therefore, if x’ is the partition induced by S, , we see that 7’ is a refinement of 
x. (In general, if S; induces x; fori = 0 or 1 and if S;: & Sp, then m is a refine- 
ment of 7). 

We shall now prove that, conversely, 7 is a refinement of x’. This will show 
that x’ = and hence that S, induces . Since we have already shown that S, 
contains any S, that induces 7, this will establish that S, is the largest member 
ac.. 

Let E. be the set of x’ containing z. Then E; is the intersection of all A ¢ S, 
that contain x. Since by definition of S, all of these sets also contain E, it follows 
that E, © E- , as was to be proved. 

We can now state 

Lemma 3. Let C, be nonempty. Then one and only one of the subfields consti- 
tuting C, , can be induced by a statistic, namely S, . 

Hence: A necessary and sufficient condition for a subfield S, to be inducible 
by a statistic is that, S) = S,, if So induces z. 

Proor. We remark first that if T is a statistic, then the subfield S) induced by 
it is the class of all Ao ¢ S for which T™'[T(A)] = A. Now let E, be defined 
relative to x as before and let T(x) = E,. Then T[T(z)] = E, and we see that 
Ao € So (the subfield induced by 7’) if and only if Ay ¢ S and z ¢ Ap => E, | Ao. 
This shows that Sy = S, and hence that S, can be induced by a statistic. 

On the other hand, let T be any statistic whose subfield S, induces z and let 
F, = {x’ : T(x’) = T(x)}. Then 


zeAp=>F,G Ao, zeAp=>F,G Ao. 


It follows from the characterization of E, given earlier that F, € HE, . Therefore, 
AeS,,xreA=F, CA, and hence A ¢ &. It follows that S) = S,. 

One might hope that Lemma 3 would establish the existence of a necessary 
and sufficient statistic as S, , where x is the partition induced by a necessary and 
sufficient subfield. Unfortunately, however, the notion of statistic is not invariant 
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under equivalence [S, P]. A subfield equivalent to a statistic need not itself be a 
statistic. In an attempt to avoid this difficulty, one may define a pseudo-statistic 
as any subfield equivalent to a statistic. If Lemma 3 remained valid for pseudo- 
statistics in the sense that a member of C, is a pseudo-statistic if and only if it 
is equivalent to S, , this would establish the desired result. 

® The following example shows that this stronger version of Lemma 3 is not 
correct. Let S, be the class of all Lebesgue sets on the real line and Sp the class of 
all Lebesgue sets differing only by « set 0 from a set symmetric with respect to 
the origin. Clearly, {x} ¢ So for all x so that Sp ¢C,. Also So is a pseudo- 
statistic since it is equivalent to the subfield induced by T(x) = |x|. But clearly 
S and S, are not equivalent. 
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A NOTE ON CONFIDENCE SETS FOR RANDOM VARIABLES 


LIONEL WEISS 
University of Virginia 
Suppose the chance variables X,,---, Xm, Y1,--:, Yx, have a joint prob- 


ability distribution depending on the unknown parameters 6, , --- , 0, , but other- 
wise of known form. We assume that there is a set of sufficient statistics for 


6:,°°:,%, denotedby T71(X1,---,Xm,¥1,°-:, Ya), °°:, 


T(X1,°*:,Xm,Y¥1, °°: , Yn). Weshall let X denote the vector (X,, --- , Xm), 
Y the vector (Y,, --- , Yn), 6 the vector (0, --- , %&), and T(X, Y) the vector 
(T:(X, Y), --- , T-(X, Y)). Po(A) shall denote the probability of A when the 
vector of parameters equals @, and P,(A | B) shall denote the conditional proba- 
bility of A given B when the vector of parameters equals @. 

Given a number a between 0 and 1, if for each vector X we can find a set S(X) 
in n-dimensional Euclidean space such that Po(Y in S(X)) = a identically in 
6, then the system of sets S(X) is called a “‘parameter-free confidence set of level 
a for the random vector Y.” 

Since T(X, Y) is a set of sufficient statistics for @, the joint conditional distribu- 
tion of Y given that T(X, Y) = t = (t,, --- , t,) is independent of 6. But then 
for any given vector ¢, it is possible to construct a region S’(t) in n-dimensional 
Euclidean space such that Ps(Y in S’(t) | T(X, Y) = t) = a@ identically in 6 
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(This last sentence is true if the conditional distribution of Y given that 
T(X, Y) = tis absolutely continuous. In the other cases only approximate equal- 
ity may be possible.) Then we have P,[Y in S’(T(X, Y))] = a identically in @. 
Now for any X, we define S(X) as the set of vectors Y such that Y is in 
S’(T(X, Y)). Clearly, S(X) is a parameter-free confidence set of level a. 

This construction is the exact analogue of Neyman’s construction of confidence 
sets for a parameter, as described in [1]. 

As an example, we discuss the problem that motivated this note. We have 
two solutions, each consisting of a certain type of particles suspended in water. 
The relative concentration of the two solutions is known, but not the absolute 
concentration of either. That is, we do not know the average number of particles 
per unit volume for either solution, but we do know the ratio of the average 
numbers of particles per unit volume for the two solutions. In taking this ratio, 
we shall understand that the numerator refers to the second solution, and shall 
denote the ratio by R. V; cubic centimeters of the first solution are drawn and 
the number of particles in this volume is counted. We denote this number by X. 
V. cubic centimeters from the second solution are to be injected into an experi- 
mental animal. We denote the number of particles injected into the animal by Y. 
Y will never be directly observed. Given a number a between 0 and 1, the prob- 
lem is to find two functions of X, say L;(X) and L.(X), with L,(X) < L,(X), 
such that P[L,(X) s Y s L.(X)] = ano matter what the values of the unknown 
absolute concentrations are. From familiar considerations, it is reasonable to 
assume that X and Y are independently distributed, each with a Poisson dis- 
tribution. If @ denotes the expected value of X, then the expected value of Y is 
ré, where r = R(V./V;) and is therefore known. 6 is unknown. Then we wish to 
have P,{[L,(X) s Y s L.(X)] = aidentically in 6. It is easily verified that X + Y 
is a sufficient statistic for 6, and that 


P(Y = y|\X+ Y¥ =2) = (eva + r)P1/(1 +r), 
that is, the conditional distribution of Y given X + Y is binomial and is inde- 
pendent of @. For any given value of X + Y, we can find two numbers M,(X + Y) 
M.(X + Y)sothat P[Mi(X + Y) S Y S M.(X + Y) | X + Y]is approximately 
equal to a@ irrespective of the value of 6. If X is large enough to make both 
Xr/(1 + r) and X/(1 + r) large, then the conditional distribution of Y given 
X + Y is nearly normal, and we have as a good approximation 


M(X + Y) = (X + Y)r/( +r) — kV(X + Y)r/1 + 2, 
MAX + Y) = (X + Y)r/(l +r) + kV (X + Y)r/(1 + 22, 


where k depends on a and is found from the table of the normal distribution. 
Then the confidence set S(X) is the set of all values of Y such that M,(X + Y) Ss 
Y < M.(X + Y), and using the approximate values of M,(X + Y) and 
M.(X + Y) from the preceding sentence, we find that S(X) consists of all 
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values of Y between the limits 
L(X) = 4{2rX + rk’ — kV/kr + 4rX(1 + nh, and 
L,(X) = ${2rX + rk’ + kV? + 4rX(1 + 7)}. 


Therefore, for these limits, we have that P[Li(X) Ss Y s L,(X)] is approxi- 
mately equal to a, no matter what the value of @ is. 


REFERENCE 
[1] J. Neyman, “Outline of a theory of statistical estimation based on the classical theory 


of probability,’”’ Philos. Trans. Roy. Soc. London, Ser. A, Vol. 236 (1937), pp. 
333-380. 
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AN INCONSISTENCY OF THE METHOD OF 
MAXIMUM LIKELIHOOD 


By D. Basu 
University of California, Berkeley 


An example was given by Neyman and Scott [2] to show that there are situa- 
tions where the method of maximum likelihood leads to inconsistent estimators. 
In their example considered, the observations were supposed to be drawn from 
an infinite sequence of distinct populations involving an infinite sequence of 
nuisance parameters. 

An example is given here to demonstrate that even in simple situations where 
all the observations are independently and identically distributed and involve 
only one unknown parameter, the method of maximum likelihood may lead us 
astray. The example typifies the situations where the correct method of setting 
up a point estimate should begin with a test of hypothesis between two composite 
alternatives. 

Let A be the set of all rational numbers in the closed interval (0, 1) and B 
any countable set of irrational numbers in the same interval. Let X be a random 
variable that takes the two values 0 and 1 with 


if 0 € A, 


0 
P(X = 1) a 
1-@ ifoeB. 


If r is the total number of 1’s in a set of n random observations on X, then from 
the rationality of r/n it follows at once that the maximum likelihood estimator 
of @ is r/n. But r/n converges (in probability) to @ or 1 — @ according as 6¢ A 
or 6¢eB. 

Now, since A and B are both countable sets, it follows [1] that there exists a 
consistent test for the composite hypothesis @ ¢ A against the composite alterna- 
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tive 6 e B. In other words, there exists a function ¢, of the first n observations 
such that ¢, takes only the two values 0 and 1 and such that 


0 if Oe A, 
P(gn = 1|0) > 
\l if 0 e B, 


It then follows readily that the estimator 


tn = (1 — ga)r/n + ga(l — r/n) 
is a consistent estimator of @. Thus, though there exist consistent estimators for 
6, the maximum likelihood estimator is not consistent. 

For a simple construction for the function g,, let {a,;} and {8;}, for i = 


1, 2, --- , be two enumerations of the sets A and B, respectively, and let 4, be 
the distance between the two sets (a1, --- , ax) and (1 — §,--- , 1 — B,). 
Let k(n) be the largest integer k such that 5 > n~*/*. Note that k(n) increases 
monotonically to infinity. Let Ix, and Jin be the open intervals of length n~*“ 
centered around a, and 1 — #, respectively and let 


R, - U Tien ’ S, = U Jin . 
ksk(n) kgk(n) 


For every n, the sets R, and S, are clearly disjoint. Now consider a fixed k. 
For all n for which k(n) 2 k we have 


P(r/neS,| 0 = Br) = P(r/ne Jin| @ = Be) 
= P( |r/n — [1 — Bill < —n™* | @ = &) 
—lasn—o, 


because r/n is asymptotically normal with mean 1 — (; and asymptotic s.d. 
/8.(1 — B.)/n. By the same argument we have 


P(r/ne S,|0 = mw) S 1 — Pl(r/neR,| 0 = om) 


—Oasn— ~, 
Now, if we define 


(1 ifr/neS, 


Pn } : 
0 otherwise, 


then ¢, clearly has the required property. 


Acknowledgement. I wish to thank Mr. J. L. Hodges, Jr., for his help in the 
writing of this note. 
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A NOTE ON SIMULTANEOUS CONFIDENCE INTERVALS 


By Meyer Dwass 


Northwestern University 


Scheffé [1] and Bose and Roy [2] have recently given a method for making 
confidence interval estimates useful in the analysis of variance. Here we show 
that we can append to such a set of confidence interval estimates an additional 
one on D, where D’/o’ is the “distance function” which determines the power of 
the analysis of variance test. For completeness, we first determine the same set 
of simultaneous confidence intervals as in [1] and [2] in a simple way. This may 
be of at least pedagogic interest. 

Lema. Let x, +--+ , 2% stand for a point in k-dimensional Euclidean space. 
The equations of the two planes normal to a@ vector a, --- , a and tangent to a 
sphere of radius R centered at c, , --- , Ce are given by 


= az; = , ac; + R(>> a)", 7. aa; = z ac; — R(>; ay". 
This is an elementary geometric fact which we will not prove. 
The analysis of variance problem can be formulated in terms of 


y = (yr, °° 5 Yn), 
a set of n independent, normal random variables, each with variance o’, and of 
#i(y), --- , #(y), which are k independent random variables, each a linear func- 
tion of y1, --: , yn - Each #;, for? = 1, --- , k, is the linear estimate of minimum 
variance of E#; = 7; ; the variance of #; is o°. Let ms’ be independent of 


fi, e+, te 
and distributed as the sum of squares of m independent N(0, c) random varia- 
bles. The problem is to estimate or test hypotheses about a, --- , 7 or linear 
combinations of them. 

Let F,. be a number such that (0, F.) includes 1 — a of the probability of the 
F distribution with (k, m) d.f. Let C be a k-sphere centered at #:, --- , # with 
radius (kF 8°)”. For a vector a = a,, --- , a, let P;(a) and P.(a) be the two 
planes which are normal to a and tangent to C. Then 


f k (8; — y 

(1) l~-« oe £ F,>, 

i=l ks? 

which is the probability that C covers the point m , --- , 7 . This in turn is the 
probability that 7, --- , m: is located between P,(a) and P,(a) for all vectors 
a. Thus 

(2) 1—a=Pr{ > a*#; — (kF.>, ais)” < Diam < Do at; 


~ (kFa>, a;s°)" for all vectors a}. 


The last step follows from the lemma. 
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We can characterize (2) as saying: Let # be the linear estimate of minimum 
variance of xz, which is a linear combination of 7, --- , 7 , and let #(7) be the 
estimate of the variance of # based on s°. Then the confidence interval statements 


# — [kFO(e))? < x < # + [kF.0(x)}"”, 


simultaneously for all x, are correct with probability 1 — a. This result is con- 
tained in [1] and [2]. 

The quantity D’ = >- 7; is a conventional measure of the “distance” of the 
null hypothesis that 7, = --- = m = 0 from the true state of nature. The 
power of the analysis of variance test depends only on D’*/o’. Hence it would be 
useful for the experimenter to obtain some information about D. 

Making use of the triangle inequality, it follows from (1) that 


1—a S Pr{()) #i)'” — (kF as’) SD S$ (Dd fi)” + (kP os*)!"}. 


The quantity >> #; = Qj is what the experimenter calculates as the “sum of 
squares due to hypothesis.’”’ Hence, instead of just making the statements about 
the functions 7, we can make the simultaneous estimates 


f=— [kF (mr) |” Snrst#+ (kF .0(3)]"?, — > wu 
Q: — (kFas')” SD SQ + (kF as)”, 


with the probability of being correct equal to 1 — a. 
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AN INEQUALITY ON POISSON PROBABILITIES 


By Henry TEICHER 
Purdue University 


This note proves an inequality concerning the exponential series or Poisson 
distribution, however one prefers to view the matter. Specifically, it will be shown 
that if [A] is the greatest integer not exceeding X, 


for all X = 0; 
1) 
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for all integral \ > 0. 
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There are numerous ways of expressing this inequality. It will be demonstrated 
in the form 

e- for all A = 0; 
2) A, = PriX, S A} > 

4 for all integral \ > 0. 


where X, denotes a Poisson chance variable with parameter \ 2 0. The func- 
tion A), is discontinuous at the positive integers but enjoys certain monotonic 
properties which may be exploited by defining 

i 

1 


3) Awa =>. i e- for all integral n = 0. 


j=0 


Then A,,, = A,forn SX < n+ 1. As 
=> 


Xk 
r"e 
! 


n+l 
4) Ase — Aa,nti = 
- n 


dy = Cn, (say). 


On the other hand, 

een + 
(n+ 1)! 

Thus to prove that An.n > Ansi.n41, it suffices to show that c, > d, . 


Now for 0 < y < 1, the quantity [1 — y/(n + 1)]" decreases monotonically, 
whence [1 — y/(n + 1)]" > e” in (O, 1). It follows that 


5) Anti nti _ Aa nti = _ dn, (say). 


1 
6) I (n 4. Sn “r= dy > (n 4. owe, 


With a change of variable \ = n + 1 — y, we conclude that c, > d, , that is 
Boa a An+i.n41 . 
In an analogous manner, [1 + 2/n]" < e* for z > 0 and from 


1 
| (1 + 2/n)"e~“* dx < 1, 
0 
we have 


n+l vn a 
7) [ Sea< 


n! - 
That is, Ann — Anatt < Ann — Ant. Thus, in summary, we have 


8) y > An+1,41 , hota < Aa,n+1 ° 





MATRIX OF NORMAL EQUATIONS 


From well known limit theorems, 
en hy eee Pe (a al «Prien 6 
9) we . A-00 5 "— a A-+00 , Vr ~ 


1 0 
“= . ee? dy = 3. 


The second portion of inequality (2) follows directly from (8) and (9). The 
remainder is a consequence of these, of the fact that A,,, decreases monotonically 
from An,» to Aa,n4: in the interval [n, n + 1), and of 


10) Aa.n+1 > Ao = ~~ = 1, 2, — 
If an additional term is included in the sum, we note that 


(AJ+1 , 5-2 
11) i = ya st >} for alld = 0, 
j=0 ! 


since bh > Ansi.n4i for A S n + 1. A final reformulation of part of (2) is 
12) Pr{X, S A} > Pr{X, > A}, all integral \ > 0. 


Ce 


NOTE ON LINEAR HYPOTHESES WITH PRESCRIBED MATRIX OF 
NORMAL EQUATIONS 


By Joun E. MAXFIELD AND Rorert S. GARDNER 


Naval Ordnance Test Station Inyokern, 


The existence theorem proven in this note relates to the problem of finding an 
experimental design leading to the analysis determined by the given rational 
matrix A of the normal equations. The matrix B found by the method used in 
the proof always has an interpretation as specifying the rational values of some 
set of regression variables. In the interesting case in which the entries of A 
are integers, so are the entries of B, but B is not in general interpretable as an 
analysis of variance. The transpose of a matrix A will be denoted by A’. 

TuHeoreM. Let A be a symmetric positive semidefinite matrix with rational in- 
tegral entries. There exist a rational integer a and a matrix B having rational in- 
tegral entries such that BB” = a’A. 

Proor. There exists a nonsingular matrix P such that P’AP = D, a diagonal 
matrix, where P and D have rational entries ([1], p. 56). Then (P”)™ has rational 
entries. Let a; be the least common denominator of the entries of P’, a, of (P”)™', 
and a; of D. Let a’? = a,a.a;. Then a’’P’a'”’AP = aD. If Ais positive semidefi- 
nite, then aD has only positive integers or zeros on its diagonal. Let B, be a 
n x 4n matrix composed of four diagonal n x n matrices placed side by side, 
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(S,S2S;S,), such that ad;; = > i148/;, where ,s;; is the entry in the ith column 
of S, . This can always be done by the 4 square problem ([2], p. 235). Let B = 
a‘*(P")"B, , then B has integral entries, since B, and a’?(P”)~ have integral 
entries. Then 


P™B =a'"B,,  P'BB’P = aB,Bi = a’D, 
Thus BB” = a(P’)'a'"Da'’P™. But A = (P’) "DP. Thus BB’ = a’ A. 


REFERENCES 
{1] C. C. MacDurrgsz, The Theory of Matrices, Chelsea Publishing Co., 1946. 
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ABSTRACTS OF PAPERS 


(Abstracts of papers presented at the Iowa City Meeting of the Institute, November 26-27, 1945) 


1. The Distribution of the Number of Components of a Random Mapping 
Function. (Preliminary Report.) Leo Karz, Michigan State College, and 
Jay E. Fotkert, Michigan State College and Hope College. 


A set H, of N elements, is mapped into itself by a function f. The most general function 
takes each point into an arbitrary number of points of the set. A function issaid to be random 
if the r; images of the point z; may with equal probability be any subset of r; points of H. 
A subset h of H is a component of the mapping if it is a minimal subset such that f(h) Ch 
and f-'(h) C h. Every mapping f decomposes H into a number of disjoint. components. The 
probability distribution of the number of components of a random mapping, where only the 
numbers of images of each point are known in advance, is obtained. The probability dis- 
tribution of the number of components is also obtained for a variant case in which the 
mapping is hollow in the sense that no point maps into itself. The two distributions are 
obtained through a modification of the King-Jordan-Frechét formula. For each case two 
specializations are considered; first, one in which the multiplicity of images is the same for 
each point of the set, and second, where this common multiplicity is unity (so that the 
function f is single-valued). Numerical examples and approximations to the exact distri- 
bution are considered. This work was supported by the Office of Naval Research. 


2. Approximate Sequential Tests for Hypotheses about the Proportion of a 
Normal Population to One Side of a Given Number. WiLiti1Am KruskKat, 
University of Chicago. 


It is sometimes of interest to test the hypothesis that the proportion of a given population 
exceeding a given number U is po against the hypothesis that this proportion is p; . This 
testing situation has been called that of testing for one-sided fraction defective. If the 
population is normal then the problem is to test the hypothesis (U — »)/o = Ko against the 
hypothesis (U — u)/o = K, . (Here u is the mean, o? the variance, and K; the unit-normal 
deviate exceeded with probability p; .) A simple translation puts this in the form: y/o = 
Ko vs. u/o = K, . If a sequential test is desired, it is very reasonable to base it on the se- 
quence of Student ¢ values computed from the first n observations. Application of the Wald 
sequential probability-ratio method to this sequence gives a procedure that may be called 
the WAGR test (after Wald, Arnold, Goldberg, and Rushton). Another sequential test 
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procedure for this problem has been suggested by Wallis. A sequence of successive ap- 
proximations to the WAGR test is derived; of these the Wallis procedure is the final ap- 
proximation. When the true value of (U — u)/o is distant from Ky and K; any of these 


sequential procedures may lead to unduly large average sample sizes. A suggestion is made 
to overcome this difficulty. 


3. A Note on Some Limit Theorems in Probability Theory. Jonn Gur Lanp, 
Iowa State College. 


A theorem by Cramér on the limiting distribution function of a sequence of random 
variables is extended by widening the class of functions to which the theorem applies. 
A theorem by Mann and Wald is modified by relaxing the continuity restrictions. The 
present note utilizes the continuity theorem for the limit of a sequence of characteristic 
functions in establishing the results stated. 


4. Uniqueness of Latin Square Association Schemes for Partially Balanced 


Incomplete Block Designs. (Preliminary Report.) D. M. Mresnrr, Purdue 
University. 


In Latin square type partially balanced incomplete block designs with 7 constraints, first 
associates are defined by means of a square array of the n? varieties with i — 2 mutually 
orthogonal Latin squares. m = i(n — 1) and pir = i(i — 1), determining n: and the re- 
maining pim . For i = 1 the designs reduce to a special case of Group Divisible, for which 
Bose and Connor proved a uniqueness theorem (Ann. Math. Stat., Vol. 23 (1952), p. 368). 
The analogous theorem here, that a design with the given parameter values implies the 
existence of the square array, is proved for i = 2. In this case, an arbitrary pair of first 
associates have as common first associates n — 2 additional varieties; these n varieties are 
assigned to one row of the array. Investigation of the incidence matrix of first associates 
shows that they are pairwise first associates. This is then used to show that the remaining 
association relations are those defined by the remainder of the array. The cases i 2 3 are 
being investigated and partial results have been obtained. That a complete generalization 
is impossible is shown by examples for which designs exist but the Latin squares do not. 
One example corresponds to the non-existent 6 X 6 Graeco-Latin square. 


5. On Bounds for the Normal Integral. J. T. Cav, University of North Carolina. 


Let v(z) = f> (2r)-§ e~*? dt, and u(z, a) = 4 (1 — e-*2*)!, for all z = 0. Then u(z, a) S 
v(x) S u(z, b) if and only if 0 S a S 4, and b = 2/z. Therefore u(z, $) and u(x, 2/7) are 
respectively the best possible lower and upper bounds for v(x) of the type u(z, a). The 
ratio v/u(}) is a steadily decreasing function of z and has an upper bound 2/z!. If w(z, a) = 
$[az?/(1 + az*)}!, then v(x) 2 w(z, a) if and only if 0 S a S 2/z, and w(z, 2/7) is the best 
possible one of the type w(z, a). Comparisons are made of the two new lower bounds for 
v(x) and several known ones converted from inequalities for Mills’ ratio, obtained by R. D. 
Gordon, Z. W. Birnbaum, and R. F. Tate (Ann. Math. Stat. (1941), 364-366; (1942), 245- 
246; (1953), 132-134). Of the three: w(z, 2/r), u(x, 4), and Tate’s (} + (e-**/2rz*))} 
— (e-2*/2/z(2x)'), it is found that approximately the first is the best for 0 < z < 1, the 
second, for 1 S z S 1.01, and the last, for z = 1.01. 


6. Rules for Determining Error Terms in Hierarchical and Partially Hierarchi- 
cal Models, Mary Lum, Wright Air Development Center. 


In the classical analysis of variance procedure a linear mathematical model is used, 
together with certain well-known assumptions, as a basis for determining proper test 
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factors for the F-test of significance. This paper is concerned with models for which one or 
more factors are of the ‘‘within’’ or ‘“‘nesting’’ type, with complete replication for the other 
factors. A set of rules is given for obtaining the appropriate test factors (error terms) for 
all main effects and interactions of the general n-factor partially hierarchical model. These 
rules take into account models which are fixed, mixed, or random in nature. The usual as- 
sumptions of the analysis of variance are made, with one exception: a weaker set of re- 
strictions is imposed concerning the independence of the interaction effects. The resulting 
test factors are compatible with those which result from the randomization theory approach 
of Kempthorne and Wilk. To illustrate the convenience and usability of these rules, two 
examples are given. 


(Abstracis of papers presented at the Annual Membership Meeting, December 27-30, 1954) 


7. Maximum Likelihood Estimates of Monotone Parameters. H. D. Brunk, 
University of Missouri. 


The maximum likelihood estimators of distribution parameters subject to certain order 
relations are determined for simultaneous sampling from a number of populations, when 
(i) the order relations may be specified by regarding the distribution parameters, of which 
one is associated with each population, as values at specified points of a function of n 
variables monotone in each variable separately ; and (ii) the distributions of the populations 
from which sample values are taken belong to the exponential family (cf. Girshick and 
Savage, ‘“‘Bayes and minimax estimates for quadratic loss functions,’’ Proc. Second Berk. 
Symposium, Univ. of Calif. Press, 1951, pp. 53-73; p. 65). The results of the present paper 
generalize those of Ayer, Brunk, Ewing, Reid, and Silverman, “An empirical distribution 
function for sampling with incomplete information,’’ to appear in Ann. Math. Stat., which 
treats the special case in which n = 1 and the distribution is binomial. This paper also 
represents a specific application of results obtained by Brunk, Ewing, and Utz on min- 
imizing integrals in certain classes of monotone functions (to be offered for publication). 
This research was supported by the United States Air Force, through the Office of Scientific 
Research of the Air Research and Development Command. 


8. Extension of Certain Classes of Contagious Distributions. Joun GuRLAND, 
Iowa State College. 


Beall has recently shown that Neyman’s types A, B, and C of contagious distributions 
are members of a certain general class of contagious distributions. The present paper 
provides alternative ways of extending this class of distributions, and discusses the in- 
terrelations which exist among various classes. The methods employed are similar to those 
in recent articles on the subject. 


9. Recurrent Markov Processes II. (Preliminary Report.) T. E. Harris, The 
Rand Corporation. 


All sets considered are Borel measurable. For X a real set, let P"(z, EF) = 
Prob (z, ¢ E) | x = x) forn = 0, 1, --- be the iterates of a temporally homogeneous Markov 
transition function; m is a sigma-finite measure. Condition 1: m(B) > 0 implies 
Prob [z, ¢ B i.o. | xo] = 1, for all 2) « X. Condition 1 implies (abstract, Nov. 27, 1954 AMS 
meeting, Los Angeles) existence of a sigma-finite measure + where 7(X) = @ is allowed, 
such that m is absolutely continuous with respect to x, with r(Z) = J, r(dz)P'(z, E), for 
all E c X. Next, Condition 1 being satisfied, suppose A C X, with 0 < r(A) < ~; suppose 
the Markov process, obtained by observing only those x, which are in A, satisfies condition 
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Do (Doob, Stochastic Processes, p. 221). Then 


lim D¥_, P(x, E)/Z*_, P*(y, F) = 2(E)/x(F) 


N-0 


for all z, y, Z, F in A, provided x(F) > 0. 


10. The Role of Perks’ Distributions in the Theory of Wiener’s Stochastic 
Function. JosepH TaLacko, Marquette University and University of 
California. 


In ‘‘Wiener’s Random Function, and other Laplacian Random Functions,’’ by Paul 
Lévy, Second Berkeley Symposium on Math. Stat. and Prob., 1951, pp. 171-187, Wiener’s 
function has been applied to the study of the Brownian plane curve. For the area between 
an are and its chord particular solutions of the relative transition probability are found. 
This paper, using the method of characteristic functions, shows that the solutions are all 
non-Gaussian and from the Perks family of functions f(z) = c(e™* + k + e~**)-!, where 
0Osks2. 


11. On the Orthogonality of Measures and the Existence of Consistent Tests. 
CHARLES KraFt, University of California. 


Let (XX, @) = IIE, (XC; , @;) and let {P} and {Q} be any two families of measures on @. 
|P} is called orthogonal to |Q} when there is a set A in @ such that P(A) = land Q(A) = 0 
for all P ¢ {P} andQ « {Q}. When the families each contain one element, their orthogonality 
is equivalent to the existence of a consistent test between the simple hypotheses P and Q. 
Further, the orthogonality can be characterized in terms of ‘‘distances’’ between the n- 
dimensional distributions. This characterization is a generalization of the one given by 
Kakutani for product measures. It is shown that the orthogonality of the two families of 
measures and the existence of a consistent test for the corresponding hypotheses are identi- 
cal as long as the families are countable, but that this is not necessarily the case when the 
families are not countable. The methods used for these problems are then applied to the 
problem of consistency for likelihood ratio test and maximum likelihood estimates for 
cases when the observations are dependent. 


12. The Minimax Character of the Neyman-Pearson Critical Region. L. M. 
Court, Diamond Ordnance Fuze Laboratories. 


In his ‘‘Statistical Decision Functions”’, Wald indicates that the Neyman-Pearson theory 
of testing statistical hypotheses is a special case of Decision Theory for which d(0) ¢ De = 
(1, --- , N) and d(x | s,) e Dt = (dj, d3). By a further natural restriction of the class of 
decision functions to be considered, the minimax character of the Neyman-Pearson critical 
region is easily established. Since a minimax solution of a decision problem is essentially 
also a Bayes’ solution with respect to a least favorable a priori distribution, the Neyman- 
Pearson critical region also corresponds to a Bayes’ solution. 


13. On the Existence of Linear Regressions. T. S. Fercuson, University of 
California. 


Let & and » be independent nondegenerate random variables with zero means. If the 
regression of § on X = at + 7 is linear for two values, a; and a. , of a with |a;| # |al, 
then & and » are both semistable in the sense of P. Lévy, with the same characteristic ex- 
ponent. Hence if second moments are assumed, both £ and are normal. If the regression of 
£ on X is linear for three values a; , a , and a; of a, with log |a;/a2| and log |a;/as| incommen- 
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surable, then both & and 7 are stable. This extends the results of E. Fix: ‘‘Distributions 
which lead to linear regressions,’’ Proc. Berkeley Symposium on Math. Stat. and Prob., 
Univ. of Calif. Press, 1949. Two further results are obtained. (1) If the regression of £ on 
X; = aé + m and Xz = azé + n2 is linear where £; m: , and nz are independent nondegenerate 
random variables with zero means, and a; ~ 0 ¥ a, then &, ; , and m2 are each normal. 
(2) Let X = AE + » where é and » are independent s- and n-dimensional random vectors, 
respectively, with zero means, and A is an n X s matrix of constants. The components of 7 
are assumed independent and at least one of them nondegenerate. If the regression of bé 
on X is linear for all values of the matrix A and the vector b, then for n = 1 both — and » 
are multivariate <table and for n > 1 both ¢ and » are multivariate normal. 


14. On the Asymptotic Distribution of U-Statistics Modified by the Introduction 


of Estimates of Parameters. (Preliminary Report.) B. V. SukHartme, 
University of California. 


Let X,,--- , X, be n independent identically distributed r.v.’s with e.d.f. F(x — @). 
Let 6,(X:,--- , X,) be an estimate of @ such that given « > 0, there exists a number b 
such that for n sufficiently large, P{\6. — 6| 2 b/ /n} S «. The paper investigates the 
asymptotic behavior of U-statistics when each observation is centered at 6, and shows that 
under certain mild restrictions, they are asymptotically normally distributed. Conditions 
are also given under which these statistics have the same asymptotic normal distribution as 
the original U-statistics. These results have been extended to random vectors, to functions 
of several U-statistics, and to the type of statistics that occur in testing the hypothesis 
that two populations differ only in location. 


15. Essentially Complete Classes of Experiments. Sytvain EHRENFELD, Colum- 
bia University. 


An experimenter has available a family of independent random variables Y, depending 
on a parameter 6 ¢ 2 © E) and where z ¢ A C E), with A compact and EF“) and E™ 
Suclidian spaces. This paper deals with choosing the z’s if the experimenter is restricted to 
a finite number of observations. Suppose Y, is normally distributed with mean y (6, x) 
and variance o*. Let &y(B) be the class of experiments with z restricted to B C A, and let 
Ves... -sop(t'@) be the variance of the maximum likelihood estimate of t’@ when Y,, 
are observed. &y(B) is said to be essentially complete if for any z; (j = 1,--- , N) with 
x; € A and any unknown 6 ¢ 2 © E‘”) there exists a set z; (j = 1,---,8) withs < N and 
zjeB CA such that Vai a(t’) s V:, ryt’) for allt ¢e E‘. The notion of asymptotic 
essential completeness is defined and several classes are shown to have the above property 
for this general case. In case ¥(6, z) = x’@ (the linear Hypothesis) stronger results can be 
proven without the normality assumption. Let r(A) C A be defined as follows: r(A) = 
{A(x)z | x € A} where A(z) is for each ze A (x ¥ 0) ascalar such that A(z) = landA(z)reA, 
while if \’ > A(z) then \’ non-e A. It is shown that: (a) &y(r(A)) is essentially complete 
forall N; (b) if bi, --- , 6, are s vectors in r(A) such that their convex closure contains 
r(A), then &y(b: , --+ , 6s) is asymptotically essentially complete; (c) with bi, --- , 6, as 
above &y+4s(bi , --- , bs) is essentially complete with respect to &y(A) for all N. 


16. A Theorem on Uniform Convergence of Families of Sequences of Random 
Variables. Emanuet Parzen, Columbia University. 


In the author’s paper “On uniform convergence of families of sequences of random 
variables” (Univ. Calif. Publ. Statist., Vol. 2 (1954), pp. 23-54), a theorem (18D) was stated 
which is a uniform analogue of theorem 20.6 in Cramér’s Mathematical Methods of Statistics 
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(Princeton, 1946). In this note we state a theorem, more general than our previous theorem, 
which pays attention to UC* convergence, and does not impose unnecessarily broad equi- 
continuity conditions on the limit distribution functions. This theorem applies to the 
multivariate case as well as to the univariate case, and may be proved as an immediate 


consequence of the Uniform Continuity Theorem. Assumptions: Let r-dimensional random 
rei* 


vectors X‘"(@) ——>» X(@), and s-dimensional random vectors Y‘" (6) wn a(@), constants, 
uniformly in @. For j = 1, --- , m, let u;(x, y, @) be a family of real-valued Borel func- 
tions, such that, for each x, u;(x’, y, 0) — u;(x, a(@), 6) uniformly in @ as |x’ — x||— 0 and 
lly — a(@)|| — 0, and, for each x, |u;(x, a(@), @)| is bounded uniformly in @. Define 
u(x, y, 0) = (u(x, y, 0), --- , Um(x, y, 6)). Let Z'"(6) = u(X'™(6), Y'™(6), 6). and 


‘* 


Z(@) = u(X(@), a(@), 6). Conciuston: Z‘™(¢) ——> Z(8). 


17. Decision Procedures for the Comparison of Exponential Populations. F. 8. 
McFeety and J. E. Freunp, Virginia Polytechnic Institute. 


Minimax procedures are applied to the comparison of two exponential populations to 
determine optimum sample size if one of two alternatives must be accepted. Interpreting 
the first r out of n ordered observations from each population as failures in a life test, the 
loss function is taken as 


L = ¢:(1 — 6;/62) Pr{@; > 62} + Qcar + 2co(n — r) + 362 DVja(n — j + 1)7 


assuming that 6. > 6, . In order, the terms stand for losses due to wrong decision, to 
items used, and to cost of experimentation. Boundedness is obtained by considering L to be 
split into components L, and L2 consisting of the first two and last two terms of L respec- 
tively. Minimax procedures applied to L, yield an r which is subsequently used in minimiz- 
ing Le for n. Values of r and n are tabulated for selected values of the constants in L. 


18. The Efficiency of Some Nonparametric Competitors of the ¢-test. J. L. 
Hopeegs, Jr. and E. L. LeamMann, University of California. 


Consider samples from continuous distributions F(z) and F(z — 6). We may test the 
hypothesis @ = 0 by using the two-sample Wilcoxon test. It is shown that its asymptotic 
efficiency (in the sense of Pitman), relative to the t-test, never falls below 0.864. This lower 
bound is attained when F’(z) is parabolic. A number of alternative notions of asymptotic 
efficiency are compared. In particular, the limit of the power efficiency function of Dixon at 
a fixed alternative is derived for the sign test relative to the t, for normal F. 


19. Multi-level Continuous Sampling Plans. Geratp LIEBERMAN, Stanford 
University, and Hersert Sotomon, Teachers’ College, Columbia Uni- 
versity. 


In 1943, Dodge (Ann. Math. Stat., Vol. 14 (1943), pp. 264-279) published a sampling 
inspection plan for continuous production for production in statistical control. Wald and 
Wolfowitz (Ann. Math. Stat., Vol. 16 (1945), pp. 30-49) later gave a continuous sampling 
plan which guaranteed a prescribed Average Outgoing Quality Limit (AOQL) even when 
production is not in statistical control. An inconvenient feature of both plans is the abrupt 
change between 100 percent inspection and partial inspection. Multi-level continuous 
sampling plans are introduced to provide smoother transitions between partial inspection 
and 100 percent inspection. The Dodge plan is a special case occurring when there is one 
sampling level. The Average Outgoing Quality (AOQ) function is derived for a k-level plan. 
Contours of constant AOQL are developed for two-level sampling plans and infinite level 
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sampling plans. An approximation is given for contours of constant AOQL for other levels. 
The choice of a specific multi-level plan is discussed in terms of minimum average fraction 
inspected and local stability. 


20. Numerical Values for Covariances of Order Statistics for Samples of Size 
Twenty and Less from the Normal Distribution. D. TercHroew, Uni- 
versity of California. 


This paper gives the covariances to more than ten decimal places. The method of com- 
putation is given and auxiliary tables obtained in the process are described. These tables 
include the normal density function, the normal probability integrai and its first nineteen 
powers. All these functions are now available to twenty-five decimal places for the argu- 
ment increasing in steps of .02. 

The table of covariances is the end result of a project proposed by W. J. Dixon to the 
Institute for Numerical Analysis of the National Bureau of Standards. The project was 
started before and completed after the Institute for Numerical Analysis had become Numer- 
ical Analysis Research of the University of California, Los Angeles. The project was sup- 
ported by the Office of Naval Research, 


21. Estimation of the Parameters of the Rectangular and the Exponential 
Populations from Singly and Doubly Censored Samples. A. E. SarHan, 
University of North Carolina. 


The best linear estimates of the parameters of the rectangular population f(y) = 1/62, 
6: — $62 S y S 0: + $62, and of the exponential population f(y) = o~' exp [—(y — u)/e], 
where « S y S ~, and the variances and relative efficiencies of these estimates are worked 
out for singly and doubly censored samples of size n. The corresponding quantities are also 
derived forthespecial cases f(y) = 1/6. , whereO S y S @ , and f(y) = 0/e—'e — y/o, where 
OsSys~. 


22. Estimation from “Censored” Samples of Extreme Data. Junius LiesLern, 
National Bureau of Standards. 


In a previous report (NACA Technical Note 3053), the author has obtained unbiased 
minimum-variance order statistics estimators of an arbitrary linear function of the two 
parameters of the extreme-value distribution with c.d.f. P(z) = exp|—exp[— (zx — u)/8}}. 
These estimators are ‘“‘optimum”’ within the class of all linear functions of the order sta- 
tistics of a sample of given size n. The present paper extends these methods, together with 
the necessary tables, to the case of a ‘‘censored’’ sample, defined as one where the total 
number of observations is known but full information is not available with regard to some 
of them. For example, in fatigue testing, the test may be discontinued before all test speci- 
mens have failed, so that the endurance lives for the ‘‘run-outs’’ are not available. The 
method is applied to an example of fatigue life-testing of ball bearings. 


23. On the Probability Integral Associated with a Certain Multivariate Test. K. 
V. RAMACHANDRAN, University of North Carolina. 


The acceptance region co S all c(S:S3') < co has been proposed by Roy for testing the 
hypothesis Hy: 2: = 22, where 2; and XZ, stand for the dispersion matrices of two p- 
variate normal populations, S; and S; for those of two random samples from them, c(S,S3') 
for the characteristic roots of S,Sz', and cy and co are two preassigned positive constants. In 
this paper a technique for obtaining the probability P{co < all c(S,Sz') < co|Ho] is devel- 
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oped which is an extension of the previous methods due to Roy, Nanda and Pillai for ob- 
taining P{all c(SiS3') < Co | H,] or Pleo S all c(S,Sz') | Ho]. The actual expressions for the 
probability are given for p = 2, 3, 4 and 5. 


24. Some Uses of Quasi-ranges. J. T. Cuu, University of North Carolina. 


Confidence intervals for, and tests of hypotheses about, the difference of two quantiles 
(of the same distribution) are obtained, using the difference (called quasi-range) of two 
properly chosen order statistics. Let 0 < p < gq < 1 be given and &, and &, be the pth and 
qth quantiles of a certain distribution. Let z, and z, , with r < s, be the rth and sth order 
statistics in a sample of size n. Then 


P{(z.— 2) = (&¢ — &p)} 2 Bn (8 —1,¢q) — Ba(r—1, p) = L, 


where B,(r, p) = Li-0(7)p*(1 — p)"~*. Corresponding to every integer k, withO Sk Sn—1, 
define r = [(n — k)p / (1 — c)] + 1, ands = r + k, where [z] is the integral part of z, and 
c = q — p. Then L is a nondecreasing function of k. Fora given a (and sufficiently large n), 
choose the least integer k such that L = 1 — a. Then P{(z, — z,) = (&, — &)} 21 — a. 
If the parent distribution satisfies certain continuity conditions, then z, — 2; is a consistent 
estimate of —& — &» and variance O(n~'). Confidence lower bounds and intervals for, and 
tests of hypotheses about, & — £, can be obtained in similar ways. Applications are given 


to the standard deviation of a normal distribution, quantiles, and the proportion of de- 
fectives in a lot. 


25. Inadmissibility of the Usual Estimate for the Mean of a Multivariate 
Normal Distribution. CHartes M. Stern, Stanford University. 


If X, , --- , X, are independently normally distributed with unknown means £; , --- , && 
and variance 1, the usual estimate of &; is X; . If the loss is the sum of squares of the errors, 
this estimator is admissible for n < 2, inadmissible for n 2 3. In the latter case, a better 
estimator is {1 — (n — 2) / (ec + =X%)]X; , with c sufficiently large. The constant c should 
be chosen to increase with n a little faster than +/n, and the estimate should be replaced by 
0 if the correction factor is negative. As D& — , this yields asymptotically the best pos- 
sible improvement over the usual estimator among all estimators having spherical sym- 
metry about the origin. For large Dé or large n, the mean squared error of the proposed 
estimator is nearly n — (n — 2)? / (2 + n). For large n, it is nearly a Bayes’ estimator 
with respect to any spherically symmetric a priori distribution. For extremely large n, 
it seems desirable to represent the parameter space as an orthogonal direct sum and apply 
the method separately in each of the spaces entering into the direct sum. In many ex- 
perimental designs there is a natural way of doing this, for example by the order of the 
interaction. Better approximations are needed before this method can be applied freely. 
It seems likely that the present results can be extended to a large class of problems in which 
one is interested in estimating many parameters with a single overall measure of the error. 


26. A Locally Optimal Test for the Independence of Two Poisson Variables. 
MouaMep S. AHMED, University of California. 


Let (x; , ys), fori = 1,2, --- , n, be independent observations on a bivariate Poisson with 
respective expectations \ and yu. It is shown that no test for the independence of z and y 
can be both similar in A, » and also uniformly most powerful. However, a test of the form 
Lr (xi — 2)(yi — 9) = cn(Z7)* is similar and locally most powerful. Using a theorem on the 
convergence to a normal of the conditional distribution of 2? (x; — %)(yi — 9), given 2 
and g, asymptotic formulae for the values of the c,’s corresponding to a given level are 
derived. Furthermore, it is shown that the asymptotic power of the test can be obtained 
from a normal approximation. 
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27. Statistical Estimation of the Endurance Limit. E. J. Gumspex, Columbia 
University. 


The theoretical scheme for fatigue failures and life tests is the probability /s(N) of sur- 
viving N cycles under a stress S. Within any such scheme all specimens tested are expected 
to fail after a finite number of cycles. However, numerous observations show cases where 
n’ out of n pieces tested survived 10’ or 108 cycles, which is taken as infinity. A stress Sp 
so small that the probability of surviving an infinity of cycles is equal to unity is called 
the endurance limit. It can exist provided there exist minimum lives No,s , that is numbers 
of cycles before which fracture cannot occur under the stress S. To explain the existence of 
an endurance limit, the probability of survival is written ls(N) = ls(#) + 1 — Is(~) Lg(N) 
where Ls(N) stands for the probability of survival up to N cycles of the broken pieces and 
ls(*) is the probability of permanent survival. A first estimate for /s(*) is the quotient 
(n — n’) / (n + 1). If the probability Ls(N) is interpreted as the asymptotic probability 
of the smallest values of a variate limited to the left by No.s , the value /s(*) can be esti- 
mated by the method of moments and successive approximations. Finally, the probability 
ls(~) is again interpreted by the same asymptotic theory of smallest values with the lower 
limit So , which may be estimated by a procedure similar to the estimation of the minimum 
lives No,s . The few reliable observations on the frequencies of permanent survival which 


are available lead to a good fit of the theory. (The work was done in part under the support 
of the Office of Ordnance Research.) 


28. On the Efficiency of Estimates in Successive Multiphase Sampling. (Pre- 
liminary Report.) B. D. Trkkrwa., University of North Carolina. 


The estimates given in a preliminary report, (Ann. Math. Stat., Vol. 25 (1954), pp. 174), 
on sampling on successive occasions for K characters from a finite population of size N, 
are further seen to satisfy the necessary and sufficient conditions for the efficiency of an 
estimate given by Patterson (1950), in view of the following lemma. Let ;X;; represent the 
ith unit observed for the jth character on the Ith occasion and ,X; the best estimate, with 
corresponding variances jo} and Vy(.X;). The correlation between the units for the same 
character on /th and mth occasions is P;,, , and the correlation betweer units for ith and 
jth characters on the same occasion is Pi; . Then 


(P3.j+(@,/mei*) CoviXijr m¥ 5"), j>J's 
CoviX ij mX je) = § P'j,5mej+/i;) CoviX i; mX 3), i<J' 


\v Prism 19j m7j, J - : J 


When! <m, ¥ = IN (@,)(Vi(:X;) / 7] + Dict (PB VEX) / 0%) (eb) — Mei os)] — 1/N, 
where limits on II are t = 1+ 1 tot = mand 4; is the weight associated with the estimate 
for jth character on tth occasion. When! => m, y = Vw(mXj) / mo; . If .X;; is not in the 


sample, y = —1/N. The estimates in an infinite population are seen to satisfy the con- 
ditions of Patterson by putting N = o. 


29. Identification of a Certain Stochastic Structure. Henry Trrcner, Purdue 
University. 


The structure characterized by z; = u; + au;_; , with the u; identically and independ- 
ently distributed, is analyzed with respect to the identifiability of the parameter a and the 
distribution of u. Under simple conditions both are identifiable. 
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30. Detection and Hypothesis Testing by Linear Methods. Emanvuet Parzen, 
Columbia University. 


The “measurement signal-to-noise ratio’’ considered by various authors, and con- 
sidered as a detection criterion by E. Parzen and N. Shiren (An analysis of a general system 
for the detection of amplitude modulated noise, to be published) is shown to be a useful gen- 
eralization of the notion of power signal-to-noise ratio, and to be unambiguously defined in 
cases where the latter is not. It is also shown that the detection criterion provides a possible 
risk function on which to base a theory of statistical hypothesis testing restricted to re- 
jection regions determined by linear functionals in the manner of estimation by linear 
methods. The test so obtained for the mean value function of a random time function co- 
incides with the test obtained for a Gaussian process by the Neyman-Pearson theory. 


31. Probability of Indecomposability of a Set Under Random Mapping. Lro 
Katz, Michigan State College. 


A set 2 of N (finite) points is mapped into itself by a single-valued function, f(z). The 
mapping, in the general case, is random if the N¥ sample points of f(z) have uniform prob- 
ability. Each function decomposes the set into a number, k, of disjoint, non-null, minimal 
invariant subsets, asQ = wi + we+ --- + wx, with f(wi) Cw; and f—'(w;) Cw; . If k = 1, 
the set is indecomposable. In the ‘‘hollow’’ case, of some importance in social psychology, 
no point maps into itself and the (N — 1)* sample points have uniform probability. For 
both cases, the probability that the set is indecomposable under the random mapping is ob- 
tained. A table of the probabilities is given for N = 2(1)20(2)40(5)100. Asymptotic ex- 
pressions for the probabilities indicate that indecomposability is more likely in the hollow 
ease by a factor of e, approximately. This last finding is significant in that it contradicts 
standard sociometric folklore, which holds that the hollow case may be approximated by the 
general one, for large N. (This work was supported by the Office of Naval Research.) 


32. On the Near Monotonic Character of the Power Function of a Certain Multi- 
variate Test. S. N. Roy and K. V. RAMACHANDRAN, University of North 
Carolina. 


In previous papers by one of the authors the acceptance region co) S c; S cp S Co is 
proposed for the hypothesis Hy): 2, = 22, and some of its operating characteristics are 
studied, where =; and 22 stand for the dispersion matrices of two p-variate normal popu- 
lations, S; and S, for those of two random samples from them, c; and c, for the smallest 
and largest characteristic roots of S,Sz', and y: S --- S yp for the characteristic roots of 
2,23". The quantities cy and co are supposed to be given by (i) P(co S c: S cp S co | Ho) = 
1 — a = Py (say); and 


aP : 
(ii) jy, (Co S 1 S cp S co| A) = 0, i=1,-++,p. 
vi = =Yp=l 


It is to be noted that (a) Ho Sy: = --- =yp=landH # Hy; (b) Pleo Sc: S cp S co | H) 
=P(oSsaScps colv,-* »Yp # 1) = P (say); and also that (c) the equations (ii) are 
equivalent to just one equation. In this paper it is proved (1) that if all the y’s are equal 
and stay equal, in other words, if D122 = yI(p), or =; = yZ2 , then P or the second kind of 
error monotonically decreases, that is, the power monotonically increases as 7 tends away 
from 1 (increasing or decreasing) and also (2) that when the +,’s are not equal the power 
increases as each 7; , separately, tends away from 1, provided that (i) all are greater than 1 
or less than 1 to start with and (ii) the gap between the smallest and the largest one does 
not exceed a certain value. 
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33. Simultaneous Distribution of the Mean, Standard Deviation, and Range for 
Probability Density Functions of Doubly Infinite Range. (Preliminary 
Report.) Mervin D. Sprincer, U. 8. Naval Ordnance. 


The simultaneous distribution of the sample mean (2%), standard deviation (S), and 
range (R) is derived in integral form for probability density functions f(z), for —o < z 
< «. This derivation is effected through the use of a transformation which transforms the 
sample probability element II!’ {(x,;)dz; into an element which is a function of x2 , 23, --- , 
Zn-2 , ¥, 8, R. After limits of integration of z,_, are determined, this function is integrated 
with respect to z,_, for r = 2, 3,:--, n — 2, to obtain the simultaneous dis- 
tribution F(z, S, R). Integration of F(z, S, R) with respect to #, S, and R, respectively, 
yields the joint distributions G(S, R), H(#, R), and K(%, S), whose correlation properties 
are then considered. In particular, the regression functions, scedastic functions, and cor- 
relation ratios are presented in general (integral) form for both regression systems of each 
of the joint functions G(S, R), H(%, R), and K(z, S). The methods are then applied to the 
normal density function to illustrate the procedures for determining F(z, S, R) and for 
analyzing the regression system of R on S. 


34. A Class of Asymptotic Tests of Composite Hypothesis. J. Neyman, Uni- 
versity of California. 


Let H be a composite hypothesis asserting that all the observable r.v.’s of the sequence 
{X;:} (possibly multivariate) are completely independent and have the same probability 
density p(x|6) defined for z e X and depending on a parameter point 6 = {6; , 62, --- , Os}. 
H fails to specify the value 6° of 6 except that it must belong to an open set 6. The problem 
considered is that of ‘‘asymptotically a-similar’’ regions for testing H. Let Y, = 
|X, ,X2,---,X,} and w, be a subset of X". We say that the sequence {w,} is an asymptot- 
ically a-similar critical region for testing H if P{Y, ¢ w, | 6°} ~aasn— @ for all @&¢ 6. 
Under suitable regularity conditions on p(zx|@) it is proved that, whenever for each j = 
1, 2, --- , s there is known a consistent estimate 67 (Y,) of 6{ converging to 6! so fast that 
the product +/n |67(Y,) — 6%| is bounded in probability, a family ® of asymptotically 
a-similar regions can be constructed as follows. Let v(a@) be an open set of numbers such 
that N(O, 1) ¢ »(@) with probability a. Let f(z, 6) be a sufficiently regular function on Xx 6, 
such that the expectation of f(X, 6°) is zero andits variance unity for all @ ¢ 6. Let ¢;(z, 6) = 
a(log p)/d0; , let A;(6°) be the regression coefficient of f(X, 6°) on ¢;(X, 6°) and let o7(6°) 
be the variance of f(X, 6°) — Z{A;(0°)g;(X, 0°). Finally, let w, stand for the subset of X* 
defined by 

. o(y.)) — 3 Ade? (Y ‘ 1 

2 flee (Y nd] = ae (Y,)leilz; 9 (Y,)]} ol6* (Y,)] Jn 
Then the sequence {w,} is asymptotically a-similar. The problem of selecting within @ an 
“optimum” critical region for testing H is thus reduced to that of selecting f(z, @) and 


v(a). 


€ v (a). 


35. The Transitions of a Markovian Process from Set to Set. Bayarp RANKIN, 
Massachusetts Institute of Technology. 


Let (Q, @, P) be a probability space, (Tf, ®) a measurable space and R* the space of 
positive real numbers. A measurable function G.(t) defined on 2 x R* to T will be called a 
stochastic process with range space I. If y represents a measurable partition of I, it is 
possible to describe the transitions of a Markovian process G,,(t) from set to set of y in terms 
of a stochastic process F.,(t) with range space y. The process F(t) is such that for any 
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géy, F(t) = g whenever G,(t) € g. In general F.,(t) will be non-Markovian, but analytically 
it may be treated as a temporally inhomogeneous Markov process. In particular, if the 
transitions of G,(t) through the points of T can be described by a temporally homogeneous 
linear diffusion equation, the transitions of F.,(t) through the points of y can be described 
by a temporally inhomogeneous linear equation which differs from the latter only in the 
coefficients. The new coefficients will be weighted averages of the old, the weighting func- 
tions being the conditional distribution of G,(t) given that G.(t) belongs to some specified 
set of 7 and given the initial conditions. Thus the ‘‘past’’ of the non-Markovian process is 
put into the coefficients. If the conditional distribution is arbitrarily assumed independent 
of time, this defines a new stochastic process F(t) which is non-Markovian but both tem- 


porally homogeneous and linear. (This work was sponsored in part by the Office of Naval 
Research. ) 


36. Confidence Intervals for the Ratio and for the Difference of Two Prob- 


abilities. (Preliminary Report.) R. R. Banapur and W. H. KruskKat, 
University of Chicago. 


Let X; for i = 1,2 be the numbers of successes in binomial samples of sizes n; with success 
probabilities 6; . The authors propose specific exact randomized tests of composite null 
hypotheses such as 6,/62 = 2 and 6; — 6, = .8, more precisely of any linear null hypothesis 
of form H: a6; + b@ + c = 0, where a, b, and c are constants. In the usual manner, such 
tests may be used to generate confidence sets for parameter functions like @;/6: and 6; — 62. 
The proposed tests are based on the observation that if Z is 1 or 0 with probability 6 and 
1 — 6, and if A and B have independent distributions on the same two points with prob- 
abilities for 1 of a and 8 respectively, then AZ + B(1 — Z) alsois 1 or 0 with probability for 
1 equal to a@ + 8(1 — @). In this way null hypotheses of form H may be reached to form 
6, = 62. The authors propose to study further the small sample and asymptotic properties 
of these tests and confidence sets. One of the authors (WHK) is studying similar methods 
in other areas, notably in components of variance problems. 


37. Limit Theorems for Conditional Distributions. G. P. Srecx, University of 
California. 


Let Un, = (Un, ++: , Unt) and Van = (Vani , «+: , Vay) be random vectors. Given that the 
limiting distribution of (U, , V,) exists, conditions are given which insure that the limiting 
conditional distribution of U,, given V, also exists. In this connection we have the following 
theorems: THEOREM 1. Let the conditional characteristic function of U, given V, = v (va 
possible value of V,,) be denoted by wn(v). If (i) (Un , Vn) converges in law to the random vector 
(U, V), and (ii) the family {w,(v)} is equicontinuous on bounded sets, then {wp(v)} can be 
extended to a family |w2(v)} such that w2(v) > w(v) uniformly for v in a bounded set, where 
w(v) is the conditional characteristic function of U given V = v. THeoremM 2. Let U, and 
V, be as indicated above. If (i) (Un , Vn) has a limiting normal distribution, and (ii) Vue és 
the normalized sum of independent random variables which are identically distributed on a 
lattice independently of n, then the limiting conditional distribution of U,» given V, is also 
normal. Theorem 2 can be extended to cases where the summands of V,, are not identically 
distributed and have distributions depending on n. An application of Theorem 1 indicates 
that with mild restrictions on the cell probabilities, the limiting distribution of the Pearson 
x? statistic (s observations, n cells) as n — © and s — ~ is normal if s?/n — o. Further, 
if the cells are equiprobable, then the limiting distribution is Poisson if s?/n — c > 0 and 
degenerate if s*/n — 0. 
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38. Tests of Contagion and Time Effect in Accident Proneness. (Preliminary 
Report.) Howarp Tucker, University of California. 


This paper considers the case of linear contagion in the theory of accident proneness 
treated by Miss Grace E. Bates in ‘“‘Contributions to the theory of Contagion’”’ (to appear 
in Ann. of Math. Stat.). In her paper Miss Bates derived a UMPU test for zero contagion 
against non-zero contagion in the absence of time effect, based on the exact times at which 
accidents occur, and in the case of one type of exposure to accidents. In this paper a model 
is considered for r types of exposure, and the Bates test is extended for this model. For 
the situation considered by Miss Bates, a test is derived based on the number of accidents 
which occur in certain time intervals. The power of this test is lower than, but comparable 
to, that of the Bates test. This test is also extended for the multi-exposure model. Finally, 
for any fixed value of the contagion parameter, a test is derived for the hypothesis of 
zero time-effect against non-zero time effect, based on the number of accidents in certain 
time intervals. 


39. Chi Square Test of Goodness of Fit for a Class of Cases of Dependent Ob- 
servations. JosePH Putter, University of California. 


In the ordinary multinomial situation, we have a sequence of vector r.v. {X, ,--- , Xam} 
such that, given Xm ,--- , Xn,x-1 , the (binomial) r.v. X,z is ®(n — Xa — --- — Xaver, De); 
we know that D7oi[Xnx. — (n — Xai — +--+ — Xn.e-s) pa]? / (n — Xm — +--+ — Xan.e-1)pe(1 — pe) 
is asymptotically distributed as x3, . This is extended to the case where p; is replaced by 
Pnk(Xmi, *** » Xn.k-1), that is, the probability of an observation falling in the kth class 
depends on the number of observations in the preceding classes. In this case, under some 
restrictions on the functions p,, , the corresponding statistic is still asymptotically a 
x} , but the number of d.o.f. is often reduced. For example, in testing the goodness of fit 
of a simple chain-binomial model of an epidemic, we get f = 1 no matter how many genera- 
tions we observe. 


40. Approximate Probability Values for Observed Number of Successes from 
Statistically Independent Binomial Events with Unequal Probabilities. 
Joun E. Wausu, Lockheed Aircraft Corporation. 


Let us consider a number of statistically independent binominal events with possibly 
unequal probabilities for ‘‘success’’. The principal problem considered is that of deter- 
mining the probability that the observed number of “‘successes”’ equals one of a specified 
set of values. Given the ‘‘success’’ probabilities, this paper presents an approximate ex- 
pression which ordinarily furnishes this probability to a reasonable accuracy and is not 
difficult to evaluate. This approximate expression is obtained by expanding the true expres- 
sion in terms of the differences between the ‘‘success’’ probabilities and their arithmetic 
average. If the variation among the event probabilities has known bounds and the upper 
bound is not too large, usable results often can be obtained in terms of these bounds and 
the average of the event probabilities. Inverse use of the results for situations of this type 
sometimes will yield approximate confidence intervals and significance tests for the average 
of the event probabilities. 
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Readers are invited to submit to the Secretary of the Institute news items of interest 
Personal Items 


Fred C. Andrews, formerly Research Associate in the Applied Mathematics 
and Statistics Laboratory, Stanford University, is now Assistant Professor of 
Mathematics and Assistant Statistician in the College of Agriculture at the 
University of Nebraska. 

Dr. R. R. Bahadur is now an Assistant Professor in the Committee on Statistics 
of the University of Chicago. 

T. A. Bancroft, director of the Statistical Laboratory, lowa State College, 
has been on a 3-month assignment during fall quarter in the Near East and 
India at the request of the Food and Agriculture Organization of the United 
Nations. During the first 6 weeks he visited experiment stations and ministries 
of agriculture in Egypt, Syria, Iran, and Iraq to collect information on the pres- 
ent use of experimental designs and survey techniques in research investigations. 
Since then he has given a program of seminars at an Experimental Designs 
Training Center sponsored by FAO in New Delhi. 

Gerald W. Barnes, formerly a graduate student at Indiana University, has 
accepted an instructorship in Psychology at the University of Maine. 

Richard H. Brown has accepted a position of Assistant Professor of Mathe- 
matics at Boston University. 

Edward C. Bryant returned to his position as Chairman of the Dept. of 
Statistics, University of Wyoming, last July after a year’s study in the Dept. of 
Statistics, Iowa State College. 

Douglas G. Chapman of the Department of Mathematics, University of 
Washington, has received a Guggenheim Fellowship for research in the statis- 
tical theory of population estimation and will be at the University of Oxford dur- 
ing the academic year 1954-55. 

Dr. Louis J. Cote has been appointed Assistant Professor of Mathematics at 
Purdue University. He will be associated with the Statistical Laboratory. 

Edwin L. Crow, formerly employed at the U. 8. Naval Ordnance Test Station, 
has accepted a position as Mathematical Statistician with the National Bureau 
of Standards, Boulder, Colorado. 

The Council and Trustees of the American Mathematical Society announce 
the election of Dr. John H. Curtiss to the position of Executive Director of the 
Society. Dr. Curtis is a fellow of the Institute of Mathematical Statistics and of 
the American Statistical Association. He assumed his duties on September 1, 
1954. The Headquarters of the Society are at 80 Waterman Street, Providence, 
Rhode Island. 

Joseph F. Daly has been granted a leave by the Bureau of the Census to spend 
a year at the Statistical Laboratory, Stanford University. 

George G. den Broeder, Jr., formerly with the Weapon Systems Analysis 
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Department of the Northrop Aircraft Company, has accepted an appointment 
as Research Associate with the Purdue University, Statistical Laboratory. 

Gerard T. Dobrindt, formerly a graduate fellow in the Mathematics Depart- 
ment, St. Louis University, received the degree of Master of Science (Research) 
from that University in June 1954 and is now employed as an Analytical Statis- 
tician in the Surveillance Branch, Weapons Systems Laboratory, Ballistic 
Research Laboratories, Aberdeen Proving Ground, Aberdeen, Maryland. 

Dr. David B. Duncan has recently resigned his position as Professor of Sta- 
tistics at Virginia Polytechnic Institute, Blacksburg, Virginia. He has accepted 
an appointment as Statistical Consultant in the Statistical Laboratory and 
Professor of Agronomy (statistics) at the University of Florida, Gainesville, 
Florida. 

A. Ross Eckler received his Ph. D. degree from Princeton University in June 
1954 and is a member of the Technical Staff, Bell Telephone Laboratories, 
Whippany, New Jersey. 

W. T. Federer is on sabbatical leave from Cornell University for the period 
September 1954 to September 1955 and is working with researchers on their 
experiments, doing routine consulting and solving various statistical problems, 
at the Experiment Station of the Hawaiian Sugar Planters’ Association and the 
Pineapple Research Institute. 

Charles F. Federspiel will spend the academic year 1954-55 doing graduate 
work at the Institute of Statistics, Raleigh, North Carolina. 

John E. Freund is spending this year as a visiting professor in the Department 
of Statistics, Virginia Polytechnic Institute. 

H. H. Goode has been appointed Professor in the Electrical Engineering De- 
partment of the University of Michigan in addition to his duties as Director of 
the Willow Run Research Center and Assistant Director of the Engineering 
Research Institute. 

W. J. Hall, having returned from a year’s study in England as a Fulbright 
Scholar, completed the Ph. D. requirements in statistics at the University of 
North Carolina in September and is now a member of the technical staff, Bell 
Telephone Laboratories, New York. 

D. G. Hays, candidate for Ph. D. in Sociology at Harvard University, is 
conducting research on stochastic models for social interaction while a Fellow of 
the Center for Advanced Study in the Behavioral Sciences, Menlo Park, Cali- 
fornia. 

Roger Heimlich, formerly Research Assistant and Graduate Student, Purdue 
University, has received a commission in the U. 8S. Public Health Service and is 
serving in the Statistics Section, Epidemiology Branch of the Communicable 
Disease Center, Atlanta, Georgia. 

J. Stuart Hunter has obtained his Ph. D. degree in Experimental Statistics, 
Institute of Statistics, North Carolina State College in June 1954, and is presently 
emp!oyed as an Experimental Statistician by the American Cyanamid Company, 
New York. 
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Koichi Ito is spending the 1954-55 academic year at the Institute of Statistics, 
University of North Carolina after receiving his Ph. D. from St. Louis University. 

Dr. C. H. Kraft of Michigan State College has been appointed to an Acting 
Assistant Professorship at the University of California. 

D. V. Lindley is on leave from Cambridge University for the academic year 
1954-55 and holds an Assistant. Professorship in the Committee on Statistics, 
University of Chicago for this period. 

Dean L. Lindstrom, formerly at the Statistical Laboratory, Purdue University, 
is now employed as Senior Aerophysics Engineer at the Fort Worth Division of 
Convair. 

Allen L. Mayerson, Principal Actuary of the New York State Insurance De- 
partment, has taken a year’s leave of absence to study at the University of Paris. 
Mr. Mayerson has been granted a Fulbright scholarship to study mathematical 
statistics and applications to actuarial work. His studies will be principally 
concerned with the Theory of Risk as developed by European Actuaries and 
Statisticians. Mr. Mayerson has recently been elected a member of the Associa- 
tion des Actuairies Suisses and of the Instituto de Actuarios Espanoles. 

Professor Frederick Mosteller, Harvard University, has been awarded a Fund 
for the Advancement of Education Fellowship for 1954-55 and is visiting the 
Committee on Statistics, University of Chicago. 

Peter G. Moore has returned to a lectureship at University College, London 
after spending a year at Princeton University as a Commonwealth Fund Fellow. 

Mervin Muller has spent the past academic year as a Fellow in Mathematics 
at the National Bureau of Standards, Institute for Numerical Analysis, Univer- 
sity of California, Los Angeles and upon completion of his Ph. D. in August has 
accepted appointment as Instructor, Mathematics Department, Cornell Uni- 
versity. 

Sidney I. Neuwirth, formerly affiliated with the Committee on Research of 
the American Medical Association, Chicago, has accepted the position of Director 
of the Statistics Division at the Mutual Insurance Advisory Association, New 
York. 

Monroe L. Norden, a Senior Associate of Dunlap and Associates, Inc., Stam- 
ford, Connecticut, has been appointed as Engineering Scientist in the Statistical 
Research and Consulting Group of the Research Division of the College of En- 
gineering, New York University, to work on problems centering about Design of 
Experiments, Operations Research and the statistical problems that arise in the 
many engineering problems which involve the representation of physical processes 
by stochastic processes. 

Boyd Z. Palmer, formerly with the American Friends Service Committee, is 
now employed as a statisticiar: in the Quality Control Department, Timken 
Roller Bearing Company. 

Stanley Reiter, formerly a member of the staff at Stanford University, has 


been appointed Assistant Professor of Economics and Mathematics at Purdue 
University. 
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Donald L. Richter, following a tour of duty with the U.S. Army, has resumed 
his studies in the Department of Statistics, University of North Carolina. 

Robert L. Rogers is now serving as Statistician of Pictsweet Foods, Inc. of Mt. 
Vernon, Washington, a division of Stokely-Van Camp. 

Dr. Jacques St.-Pierre having completed 3 years of graduate work at the 
Institute of Statistics, University of North Carolina, has returned to Université 
de Montréal. He will be in charge of the recently organized Center of Statistics. 

Marion M. Sandomire left the Atomic Energy Commission, upon the move of 
its New York Office to Oak Ridge, and has become Staff Statistician at the U.S. 
Naval Radiological Defense Laboratory in San Francisco. 

Dr. Morris Skibinsky, who received his degree in 1954 from the University of 
North Carolina, Chapel Hill, has been appointed Research Associate in the 
Statistical Laboratory, Purdue University. 

George W. Snedecor will serve as a consultant in experimental statistics for 
the Institute of Statistics, Consolidated University of North Carolina, for 4 
months beginning January 1955. 

Richard H. Titman, formerly with the General Electric Company, Richland, 
Washington, has accepted the position of research Engineer with the Operations 
Analysis Group of CONVAIR, Division of General Dynamics Corporation, 
San Diego. 

William Van der Bijl, Meteorologist, Research Associate on leave from Royal 
Netherlands Meteorological Institute, has been granted a Postdoctoral Award 
for Study in Statistics for the year 1954-55 by the Committee on Statistics of the 
University of Chicago. 

David Lee Wallace, formerly Moore Instructor in Mathematics, Massachu- 
setts Institute of Technology, has been appointed Assistant Professor of Statis- 
tics in the Committee on Statistics at the University of Chicago. 

Sidney Weiner is employed as Analytical] Statistician with Aeronautical Radio 
Inc., Washington, D. C. 

John R. B. Whittlesey, formerly a graduate student at the Institute of Statis- 
tics, Chapel Hffl, North Carolina, is now a private in the Army, working as an 
Instrumentation Analyst with the Aberdeen Bombing Mission, Edwards 
Air Force Base, Edwards, California. 

Dr. Max A. Woodbury has been granted leave from the University of Penn- 
sylvania and will serve as Principal Investigator of the Logistics Research Proj- 
ect (ONR), The George Washington University, Washington, D. C. for the 
coming year. 
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New Members 
The following persons have been elected to membership in the Institute 


August 10, 1954 to November 16, 1954 


Beckhart, Ann S. (Mrs. G. H.), B.A. (Vassar College), Graduate Student, Rutgers Univer- 
sity, 1019 Sycamore Street, Haddon Heights, New Jersey. 

Beckhart, G. H., A.B. (Princeton), Graduate Student, Rutgers University, 1019 Sycamore 
Street, Haddon Heights, New Jersey. 

Brown, Byron W., Jr., B.A. (Univ. of Minnesota), Instructor, Biostatistics Division, De- 
partment of Public Health, University of Minnesota, Minneapolis 14, Minnesota, 
Q 179 “U”’ Village, Minneapolis 14, Minnesota 

Carter, Richard Leston, M.S. (Southern Methodist Univ.), Graduate Student, University 
of North Carolina, Chapel Hill, North Carolina, Rt. #3, Box 381, Chapel Hill, North 
Carolina. 

Chasen, Sylvan H., M.S. (Emory Univ.), Supervisory Mathematician, United States Navy 
(Naval Air Test Center), Patuxent River, Maryland, Town Creek Manor, California, 
Maryland. 

Cox, D. R., Ph.D. (Univ. of Leeds), Assistant Lecturer in Mathematics, Statistical Labora- 
tory, University of Cambridge, St. Andrew’s Hill, Cambridge, United Kingdom. 
Gupta, Shanti Swarup, M.A. (Delhi Univ.), Research Assistant and Graduate Student, 

Institute of Statistics, University of North Carolina, Chapel Hill, North Carolina. 

Horberg, Arthur, M.S. (DePaul Univ.), Junior Mathematician, Institute for Air Weapons 
Research, University of Chicago, Museum of Science and Industry, Chicago 37, Illinois, 
9640 S. Chappel Avenue, Chicago 17, Illinois. 

Karlin, Samuel, Ph.D. (Princeton Univ.), Associate Professor of Mathematics, California 
Institute of Technology, Pasadena, California. Temporary, academic year 1954-55: 
Stanford University, Statistics Department, Stanford, California. 

Kawata, Tatsuo, Ph.D. (Tohoku Univ.), Professor of Mathematics, Tokyo Institute of 
Technology, Meguro-ku Oh-Okayama, Tokyo, Japan. 

Lasman, Lonnie L., B.A. (Univ. of Minnesota), Graduate student, University of Minne- 
sota, Minneapolis 14, Minnesota and Research Assistant, Department of Agricultural 
Economics, Institute of Agriculture, University of Minnesota, St. Paul 8, Minnesota, 
1358 Kenneth, St. Paul 2, Minnesota. 

McFeely, Franklin S., M.A. (Bucknell Univ.), Graduate Research Assistant in Statistics, 
Department of Statistics, Virginia Polytechnic Institute, Blacksburg, Virginia. 

Maruyama, Gisiro, Ph.D. (Kyusyu Univ.), Professor, Department of Mathematics, Ocha- 
nomizu University, 35 Otsuka-machi Bunkyo-ku, Tokyo, Japan. 

Murty, V. N., M.A. (Andhra Univ.), Graduate Student, 404 Connor Dormitory, Chapel Hill, 
North Carolina. 

O’Connor, Aloysius J., Sign writer, Schenectady Sign Service, 834 State Street, Schenec- 
tady, New York, 1344 Santa Fe Street, Schenectady, New York. 

Sukhatme, Balkrishna V., M.A. (Delhi Univ.), Research Assistant and Graduate Student, 
Statistical Laboratory, Department of Mathematics, University of California, Berke- 
ley 4, California. 

Switzer, Duane R., B.S. (Case Inst.), Graduate Student, Western Reserve University, 
Department of Statistics, Dr. W. D. Berretoni, University Circle, Cleveland, Ohio, 
5828 Cato Street, Maple Heights, Ohio. 

Udagawa, Masatomo, Ph.D. (Univ. of Tohoku), Assistant Professor, Faculty of Science in 
Tokyo Educational University, Otsuka Bunkyo-ku, Tokyo, Japan. 

Ugaheri, Tadashi, Ph.D. (Tokyo Univ.), Assistant Professor, Tokyo Institute of Tech- 
nology, O-Okayama Meguro-ku, Tokyo, Japan. 
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Cooperative Graduate Summer Sessions in Statistics 


The University of Florida, North Carolina State College, Virginia Polytechnic 
Institute and the Southern Regional Education Board are jointly sponsoring 
a series of cooperative summer sessions in statistics. 

The first of these cooperative summer sessions was held during the summer of 
1954 at Virginia Polytechnic Institute and the second session will be held at the 
University of Florida, June 20 to July 29, 1955. A session is scheduled to be held 
at North Carolina State College in 1956 and another at Virginia Polytechnic 
Institute in 1957. Each summer session will last six weeks and each course will 
carry approximately three semester hours of graduate credit. 

The faculty for 1955 session at the University of Florida will include: Professor 
R. L. Anderson, North Carolina State College; Professor D. B. Duncan, Univer- 
sity of Florida; Professor Boyd Harshbarger, Virginia Polytechnic Institute; 
Professor Carl E. Marshall, Oklahoma A. and M. College; Professor Herbert A. 
Meyer, University of Florida; Professor George E. Nicholson, Jr., University of 
North Carolina; Professor Phillip J. Rulon, Harvard University; Professor Walter 
L. Smith, University of North Carolina; and Professor Dudley E. South, Uni- 
versity of Florida. 

Courses to be offered this summer are: Statistical Methods I, Statistical Meth- 
ods II (Design of Experiments), Statistical Theory I, Statistical Theory II 
(Inference and Least Squares), Advanced Analysis I, Theory of Sampling, Theory 
of Statistical Inference, Mathematics for Statistics, Statistical Research in Edu- 
cation and Psychology and Seminar on Recent Advances in Statistics. 

Inquiries should be addressed to: 

Professor Herbert A. Meyer 
Statistical Laboratory 
University of Florida 
Gainesville, Florida 


Summer Sessions at Berkeley, California 


This year’s program at the Statistical Laboratory of the University of Cali- 
fornia, Berkeley, California, consists of two sessions: June 20-July 30 and 
August 1-September 10, 1955. The faculty of the summer sessions will include 
Professor G. E. Bates of Mt. Holyoke College, South Hadley, Massachusetts; 
Professor J. Neyman, Professor Charles H. Kraft and Mr. Howard G. Tucker of 
the Statistical Laboratory, University of California. 

The program includes undergraduate courses primarily meant for students 
transferring from other centers who would like to embark on advanced studies 
in Berkeley during the regular academic year. Professor Neyman will be available 
for consultations on work leading to higher degrees. There will be no graduate 
course program. However, graduate students may be interested in a series of 
lectures and seminars to be given through July and August in connection with the 
second part of the Third Berkeley Symposium on Mathematical Statistics and 
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Probability. The scholars who promised to participate in this event are: T. W. 
Anderson, Columbia University, M. 8. Bartlett, University of Manchester, 
J. Berkson, Mayo Clinic, David Blackwell, Howard University and University 
of California, A. J. L. Blanc-Lapierre, Université d’Alger, J. Doob, University 
of Illinois, W. Feller, Princeton University, R. Fortet, Institut Henri Poincaré, 
A Girshick, Stanford University, J. M. Hammersley, Oxford University, J. L. 
Hodges, Jr., University of California, W. Hoeffding, University of North Caro- 
lina, Lucien LeCam, University of California, Erich L. Lehmann, University of 
California, P. Lévy, l’Ecole Polytechnique, H. Robbins, Columbia University, 
Herman Rubin, Stanford University, and C. M. Stein, Stanford University. 


ee RR a 


REPORT OF THE IOWA CITY MEETING OF THE INSTITUTE OF 
MATHEMATICAL STATISTICS 


The sixty-third meeting, a Central Regional meeting, of the Institute of 
Mathematical Statistics was held at the State University of Iowa, Iowa City, 
Iowa, on November 26-27, 1954. The meeting was in conjunction with a meeting 
of the American Mathematical Society. An address entitled Results of Functions 
Analytic in a Half Plane and Their Applications to Moments and Distribution 
Functions was presented by Professor R. P. Boas, Northwestern University. 

The following 29 members of the Institute attended: 


F. C. Andrews, I. W. Burr, A. T. Craig, E. L. Crow, J. E. Folkert, W. A. Golomski, L. 
A. Goodman, J. Gurland, W. W. Gutzman, H. O. Hartley, J. L. Harter, R. V. Hogg, E. H. 
Jebe, R. J. Jessen, L. Katz, J. H. B. Kemperman, O. Kempthorne, L. A. Knowler, C. F. 
Kossack, R. M. Kozelka, W. Kruskal, D. V. Lindley, F. W. Lott, Mrs. M. D. Lum, M. R. 
Mickey, W. C. Ross, Jr., R. Stephens, J. Waksberg, and D. L. Wallace. 


The program of the meeting was as follows: 


FRIDAY, NOVEMBER 26, 1954 


9:00-10:20 a.m. Contributed Papers 


Chairman: Leo A. GoopMan, University of Chicago 

(1) The Distribution of the Number of Components of a Random Mapping Function, Pre- 
liminary Report, Leo Katz, Michigan State College, and Jay E. Fotxert, Michigan 
State College and Hope College 

(2) Approximate Sequential Tests for Hypotheses about the Proportion of a Normal Population 
to One Side of a Given Number, W1tu1AM Kruskat, University of Chicago 

3) A Note on Some Limit Theorems in Probability Theory, Joun GurRLANpD, Iowa State 
College 

(4) Uniqueness of Latin Square Association Schemes for Partially Balanced Incomplete 
Block Designs, Preliminary Report (By title), D. M. Mesnger, Purdue University 

(5) On Bounds for the Normal Integral (By title), J.T. Cuu, University of North Carolina 
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2:00-3:00 p.m. Address 


Chairman: JoHN GuRLAND, Iowa State College 
(1) Results on Functions Analytic in a Half Plane and Their Applications to Moments and 
Distribution Functions, R. P. Boas, Northwestern University 


3:15-5:30 p.m. Sampling Surveys 


Chairman: Leo A. GoopMan, University of Chicago 

(1) Precision of Unbiased Ratio Estimates, H. O. Hartiey, Iowa State College 

(2) Some Finite Population Unbiased Ratio and Regression Estimators, R. M. Mickey, 
Iowa State College 


(3) Some Methods of Estimation of Variances for Complex Sample Designs, J. WAKSBURG, 
Bureau of the Census 


SATURDAY, NOVEMBER 27, 1954 
9:30-11:45 a.m. Industrial Statistics 


Chairman: Irvine W. Burr, Purdue University 

(1) On Tolerance Limits, J. H. B. Kemperman, Purdue University 

(2) Contagious Distributions and Their Potential Use in Industry, Leo Katz, Michigan 
State College 

(3) The Location of Optimum Operating Conditions, Davin L. Watuace, University of 
Chicago 


1:00-3:15 p.m. Estimation of Error in Experiments 


Chairman: Car. F. Kossack, Purdue University 

(1) Linear Models, O. Kempruorne, Iowa State College 

(2) Interactions with Experimental Units, M. B. W1Lk, Iowa State College 

(3) Rules for Determining Error Terms in Hierarchical and Partially Hierarchical Models, 
Mary Lum, Wright Air Development Center 

Discussion: L. Harter, Wright Air Development Center 


WILLIAM KRUSKAL 
Associate Secretary 


REPORT OF THE BERKELEY MEETING OF THE INSTITUTE OF 
MATHEMATICAL STATISTICS 
December 27-30 

The sixty-fourth meeting of the Institute of Mathematical Statistics and the 
seventeenth annual meeting was held at the University of California, Berkeley, 
California, on December 27-30, 1954 in conjunction with the national annual 
meeting of the American Association for the Advancement of Science. All sessions 
of the Institute of Mathematical Statistics were joint with Section A of the AAAS. 
A number of sessions were joint with the American Statistical Association, the 
American Statistical Association-Committee on Statistics in the Physical 
Sciences,- American Physical Society, Astronomical Society of the Pacific, 
Biometric Society-Western North American Region, Ecological Society of 
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America, Philosophy of Science Association, Western Psychological Association, 
American Association for the Advancement of Science, Section A—Mathematics, 
Section B—-Physics, Section D—Astronomy, Section I—Psychology, Section L— 
History and Philosophy of Science, Section M—Engineering, Section N— 
Medical Sciences, Section Q—Education and the Third Berkeley Symposium on 
Mathematical Statistics and Probability. The following members of the Institute 
attended: 


Israel J. Abrams, Forman 8S. Acton, Om P. Aggarwal, T. W. Anderson, Kenneth J. 
Arnold, George A. Baker, Edward W. Barankin, Grace E. Bates, Joseph Berkson, Robert 
A. Bieber, Allan Birnbaum, Z. W. Birnbaum, David Blackwell, Julius R. Blum, Charles 
H. Boll, A. H. Bowker, Bernice Brown, H. D. Brunk, Herman Chernoff, C. L. Chiang, 
John T. Chu, Randolph Church, C. West Churchman, Charles R. Clark, Kermit G. Clemans, 
Edward P. Coleman, William D. Commins, Arnold Court, L. M. Court, Edwin L. Crow, 
Joseph F. Daly, Cuthbert Daniel, R. C. Davis, Robert Dorfman, F. W. Dresch, W. J. 
Dixon, John A. Dudman, Mary Elveback, Benjamin Epstein, James D. Esary, Mark W. 
Eudey, Edward A. Fay, Thomas Ferguson, Evelyn Fix, Martin Fox, William R. Gaffey, 
Robert 8S. Gardner, David W. Gaylor, G. E. Ghormley, Edgar J. Gilbert, E. 8. Gordon, 
Clayborn L. Graves, Harris T. Guard, John Gurland, Harry H. Harman, T. E. Harris, 
David G. Hays, Warren M. Hirsch, Paul G. Hoel, William C. Hoffman, Joseph L. Hodges, 
Jr., J. P. Imhof, Stanley Isaacson, R. F. Jarrett, T. A. Jeeves, Walter Jennings, Mark Kac, 
Williams E. Kane, Samuel Karlin, Leo Katz, H. Konijn, Lambert H. Koopmans, Charles 
H. Kraft, Martin Karkowski, William Kruskal, Lucien LeCam, Erich L. Lehmann, R. A. 
Leibler, Roy Leipnik, Gerald J. Lieberman, Julius Lieblein, Richard F. Link, Arvid Lon- 
seth, D. C. Lowry, E. Lukacs, Mary D. Lum, R. K. Maggy, F. Massey, Donald F. Mela, 
A.M. Mood, Roger A. Moore, L. E. Moses, Frederick Mosteller, J. Neyman, Edwin G. Olds, 
Donald B. Owen, Toby Oxtoby, Woodrew W. Page, Emanuel Parzen, J. Putter, Robert 
Putz, K. V. Ramachandran, Bayard Rankin, A. T. Bharucha-Reid, Robert Read, Mina 
Rees, George J. Resnikoff, Paul R. Rider, William L. Roach, Harry G. Romig, M. Rosen- 
blatt, A. R. Roy, Herman Rubin, David Rubinstein, Jagdish S. Rustagi, Marion M. Sando- 
mire, A. E. Sarhan, Richard Savage, Henry Scheffé, Lorraine Schwartz, Arthur Shapiro, 
Milton Sobel, Herbert Solomon, Melvin D. Springer, George P. Steck, Charles M. Stein, 
Margaret D. Stein, David S. Stoller, B. V. Sukhatme, Joseph V. Talacko. William F. Taylor, 
Henry Teicher, D. Teichroew, A. J. Thomasian, Fred H. Tingey, Donald R. Truax, Howard 
G. Tucker, William Vanderbyl, Sidney Weiner, Irving Weiss, Oscar Wesler, John R. B. 
Whittlesey, Alvin D. Wiggins, 8. S. Wilks, Max A. Woodbury, J. Yerushalmy, Royal K. 
Zeigler. 


The program follows: 


MONDAY, DECEMBER 27, 1954 


9:00 a.m. Statistics in Biology and Genetics—-With Third Berkeley Sympo- 
sium, Biometric Society (WNAR), Section A of AAAS, American 
Statistical Association, and Ecological Society of America 


Chairman: Roy E. Clausen, University of California 
Papers: 1. Struggle for Existence, Thomas Park, University of Chicago; Jerzy 
Neyman and Elizabeth L. Scott, University of California. 
2. Some Genetic Problems in Controlled Populations, Everett Dempster, 
University of California. 
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3. Some Genetic Problems in Natural Populations, James Crow and Motoo 
Kimura, University of Wisconsin 


Applications of Poisson and Exponential Distributions to Physics 
and Industry—With American Statistical Association and Section 
A of AAAS 


Chairman: Stanley Isaacson, Iowa State College 
Papers: 1. Estimates of Bounded Relative Errors for the Poisson and Other Param- 
eters, Meyer A. Girshick, Stanford University. (Presented by 
Herman Rubin, Stanford University.) 
2. On Estimating the Mean Life of a Radioactive Source, Richard F. Link, 
Sandia Corporation 
3. Survey of Some New Techniques in Lifetesting when the Underlying 
Distribution is Exponential, Benjamin Epstein, Wayne University 
4. Inference Problems in Poisson Processes, Allan Birnbaum, Columbia 
University 


1:30 p.m. Statistical Mechanics—With Third Berkeley Symposium, American 
Statistical Association, American Physical Society and Sections A 
and B of AAAS 


Chairman: Mina Rees, Hunter College 
Papers: 1. Hopf-Wiener Equation Systems and Matrix Factorization, Norbert 
Wiener, Massachusetts Institute of Technology 
2. Foundation of Kinetic Theory of Gases, Mark Kac, Cornell University 
3. Effect of Dimensionality on Long Range Order in Crystals, Elliott Mont- 
roll, Office of Naval Research 


1:30 p.m. Design of Experiments in Fisheries Work—With Biometric Society 
(WNAR), and Section A of AAAS 


Chairman: Richard Van Cleve, University of Washington 
Papers: 1. Biological Assumptions Involved in Estimating Mortalities to Down- 
stream Migrant Salmon Passing Dams, Charles O. Junge, Jr., Wash- 
ington State Department of Fisheries 
2. Use of Logbook Data in the Measurement of Distribution and Abundance 
of Commercial Fish Stocks, M. B. Schaefer, Inter-American Tropical 
Tuna Commission 
3. Some Remarks on the Design of a Sampling Program of a Fishery for a 
Measure of Fishing Intensity, T. M. Widrig, U. 8. Fish and Wildlife 
Service 


4:00 p.m. Special Invited Paper—With Third Berkeley Symposium 

Chairman: T. E. Harris, Rand Corporation 

Paper: Large Sample Theory in the Parametric Case, Herman Chernoff, Stanford 
University 


8:00 p.m. 1954 Council Meeting 


President: Edwin G. Olds, Carnegie Institute of Technology 
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TUESDAY, DECEMBER 28, 1954 


9:00 a.m. Statistics in Medicine and Public Health—With Third Berkeley 


Chairman: 
Papers: 


Discussion: 


9:00 a.m. 


Chairman: 


Papers: 


1:30 p.m. 


Chairman: 
Paper: 


1:30 p.m. 


Chairman: 
Papers: 


2:30 p.m. 


Chairman: 
Papers: 


Symposium, American Statistical Association, Biometric Society 
(WNAR), and Sections A and N of AAAS 


Charles E. Smith, University of California 

1. Problems of Contagion, William F. Taylor, School of Aviation Medicine 

2. Statistical Problems in Medical Diagnoses, Chin L. Chiang, J. L. Hodges, 
Jr. and Jacob Yerushalmy, University of California 

3. Some Statistical Problems Arising from Retrospective Studies, Jerome 
Cornfield, National Institute of Health 

Albert T. Reid, Columbia University, Ahmed E. Sarhan, University of 

North Carolina 


Principle of Invariance—With Third Berkeley Symposium and 
Section A of AAAS 


Erich L. Lehmann, University of California 

1. Canonical Representation of an Invariant Decision Problem, Meyer A. 
Girshick, Stanford University. (Presented by Herman Rubin, Stan- 
ford University) 

2. Generalized Hunt-Stein Theorem, Herman Rubin, Stanford University 

3. Admissibility of Invariant Decision Procedures, Charles M. Stein, 
Stanford University 


Invited Address—With Third Berkeley Symposium 


Henry Scheffé, University of California 
On Some Problems Arising in the Spectral and Regression Analysis of 
Time Series, Murray Rosenblatt, University of Chicago 


Statistics in Astronomy: The Spatial Distribution of Galaxies— 
With Third Berkeley Symposium, Astronomical Society of the 
Pacific, and Sections A and D of AAAS 


Joel Stebbins, Lick Observatory 

1. Statistics of Cluster of Galaxies—Distribution of Centers, Angular Di- 
mensions, Structure, Luminosity Function of Member Galaxies, Fritz 
Zwicky, Mount Wilson and Palomar Observatories 

2. Statistics of Images of Galaxies with Particular Reference to Clustering, 
Jerzy Neyman and Elizabeth L. Scott, University of California; 
C. Donald Shane, Lick Observatory 


3. Galazies, Statistics and Relativity, George C. McVittie, University of 
Illinois 


Invited Papers 


Edwin G. Olds, Carnegie Institute of Technology 

1. Random Variables and the General Theory of Variables, Karl Menger, 
Illinois Institute of Technology 

2. Multi-Stage Decision Procedures, Meyer A. Girshick, Stanford Univer- 
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sity, Samuel Karlin, California Institute of Technology and Stanford 
University and H. L. Royden, Stanford University 


4:00 p.m. Contributed Papers I 


Chairman: Paul G. Hoel, University of California, Los Angeles 
Papers: 1. Maximum Likelihood Estimates of Monotone Parameters, H. D. Brunk, 
University of Missouri 
2. Extension of Certain Classes of Contagious Distributions, John Gur- 
land, Iowa State College 
3. Recurrent Markov Processes II, Preliminary Report, T. E. Harris, 
Rand Corporation 
. The Role of Perks’ Distribution in the Theory of Wiener’s Stochastic 
Function, Joseph Talacko, Marquette University and University 
of California 
. On the Orthogonality of Measures and the Existence of Consistent Tests, 
Charles Kraft, University of California 
. The Minimax Character of the Neyman-Pearson Critical Region, L. 
M. Court, Diamond Ordnance Fuze Laboratories 
. On the Existence of Linear Regressions, T. 8. Ferguson, University of 
California 
. On the Asymptotic Distribution of U-Statistics Modified by the Intro- 
duction of Estimates of Parameters, Preliminary Report, B. V. Su- 
khatme, University of California 
. Essentially Complete Classes of Experiments, Sylvain Ehrenfeld, New 
York City. (By title) 
. A Theorem on Uniform Convergence of Families of Sequences of Random 
Variables, Emanuel Parzen, Columbia University. (By title) 
. Decision Procedures for the Comparison of Exponential Populations, 
F. S. McFeely and J. E. Freund, Virginia Polytechnic Institute. 
(By title) 
12. The Efficiency of some Nonparametric Competitors of the t-Test, J. L. 
Hodges, Jr. and E. L. Lehmann, University of California. (By title) 


8:00 pm. AAAS Presidential Address 


Address: A Half Century of Quantum Physics, E. U. Condon, Director of Research, 
Corning Glass Works, and Retiring President, AAAS. 


WEDNESDAY, DECEMBER 29, 1954 
9:00 a.m. Special Invited Paper—With Third Berkeley Symposium 


Chairman: David Blackwell, Howard University and University of California 
Paper: Probabilistic Treatment of Phenomena: Stochastic Models and Interpolatory 
Formulae, Jerzy Neyman, University of California 


10:00 a.m. Probability and Induction—With Third Berkeley Symposium, 
American Statistical Association, Philosophy of Science Association, 
and Sections A and L of AAAS 


Chairman: William R. Dennes, University of California 
Papers: 1. Problems of Values in Relation to Induction, C. West Churchman, Case 
Institute of Technology 
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2. The Measurement of Utility and Subjective Probability, Patrick C. 
Suppes, Stanford University 

3. Toward an Objectivistic Theory of Probability, Edward W. Barankin, 
University of California 


4. Inference from Confidence Limits and from Standard Errors, Joseph 
Berkson, Mayo Clinic 


1:30 p.m. Comparison of Experiments—With Third Berkeley Symposium and 
Section A of AAAS 


Chairman: Z. William Birnbaum, University of Washington 
Papers: 1. Introduction, David Blackwell, Howard University and University of 
California 
2. Comparison of Experiments in the Infinite Case and the Use of Invariance 
in Determining Sufficiency, Charles Boll, Hughes Aircraft Company 
3. On the Comparison of Information Provided by Experiments, Max A. 
Woodbury, University of Pennsylvania and George Washington 
University 


Statistics in Astronomy: The Distribution of Stars in the Hertz- 
sprung-Russell Diagram—-With Third Berkeley Symposium, 
American Statistical Association, Astronomical Society of the 
Pacific and Sections A and D of AAAS 


Chairman: Otto Struve, University of California 
Papers: 1. The H-R Diagram, Bengt Stromgren, Yerkes Observatory 
2. The Spectra and Other Properties of Stars Lying Below the Normal Main 
Sequence, Jesse L. Greenstein, California Institute of Technology 
3. Evidence for Sequences in the Color-Luminosity Relationship for the M- 
Dwarfs, Gerald E. Kron, Lick Observatory 
4. Photoelectric Studies of Stellar Magnitudes and Colors, Harold Johnson, 
Lowell Observatory 
5. Observed Relationships between Luminosity Color and Mass for Stars 
in the Solar Neighborhood, Olin Eggen, Lick Observatory 
Discussion: Mary Hanania, University of California 


4:30 p.m. Contributed Papers II 


Chairman: Leo Katz, Michigan State College 
Papers: 1. Multi-level Continuous Sampling Plans, Gerald Lieberman, Stanford 
University, and Herbert Solomon, Teachers College, Columbia 
University 
. Numerical Values for Covariances of Order Statistics for Samples of 
Size Twenty and Less from the Normal Distribution, D. Teichroew, 
University of California 
3. Estimation of the Parameters of the Rectangular and the Exponential 
Populations from Singly and Doubly Censored Samples, A. E. Sarhan, 
University of North Carolina. 
. Estimation from ‘‘Censored’’ Samples of Extreme Data, Julius Lieblein, 
National Bureau of Standards 
. On the Probability Integral Associated with a Certain Multivariate 
Test, K. V. Ramachandran, University of North Carolina 
. Some Uses of Quasi-ranges, J. T. Chu, University of North Carolina 





7:30 p.m. 
President: 


9:00 p.m. 


9:00 a.m. 


Chairman: 
Papers: 


10:00 a.m. 


Chairman: 
Papers: 


1:30 p.m. 


Chairman: 
Papers: 


Discussion: 
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7. Inadmissibility of the Usual Estimate for the Mean of a Multivariate 

Normal Distribution, Charles M. Stein, Stanford University 

. A Locally Optimal Test for the Independence of two Poisson Variables, 
Mohamed 8. Ahmed, University of California. 

. Identification of a Certain Stochastic Structure, Henry Teicher, Purdue 
University 

. Statistical Estimation of the Endurance Limit, E. J. Gumbel, Columbia 
University. (By title) 

. On the Efficiency of Estimates in Successive Multiphase Sampling 
(Preliminary Report), B. D. Tikkiwal, University of North Carolina. 
(By title) 


Business meeting 


Edwin G. Olds, Carnegie Institute of Technology 
IMS Beer Party—With Section A, AAAS 
THURSDAY, DECEMBER 30, 1954 


Mathematical Statistics—With Third Berkeley Symposium and 
Section A of AAAS 


Wilfred J. Dixon, University of Oregon 

1. On the Characterization of Populations by Properties of Suitable Sta- 
tistics, Eugene Lukacs, Office of Naval Research 

2. Decision Theory for Polya Type Distributions, Samuel Karlin, California 
Institute of Technology and Stanford University 


Statistics in Industrial Research—With Third Berkeley Symposium, 
American Statistical Association, and Sections A and M of AAAS 


Fred L. Hotes, University of California 

1. Recent Developments in Sampling Inspection, Albert H. Bowker, Stan- 
ford University 

2. Statistical Problems of Life Testing, Milton Sobel, Bell Telephone 
Laboratories 

3. Efficient Experimental Design in Industrial Research, Cuthbert Daniel, 
New York City 


Statistics in Psychology—-With Third Berkeley Symposium, 
American Statistical Association, Western Psychological Associa- 
tion, and Sections A, I, and Q of AAAS 


Joy P. Guilford, University of Southern California 

1. Some Stochastic Models for Learning Theory, Frederick Mosteller, Har- 
vard University 

2. Statistical Methods in Psychometric Research, Herbert Solomon, Co- 
lumbia University 

3. Statistical Inference in Factor Analysis, Theodore W. Anderson, Co- 
lumbia University 

Charles O. Neidt, University of Nebraska 
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1:30 p.m. The Meaning of Probability to the Engineer, Mathematician and 
Physicist—With American Statistical Association, and Section A of 
AAAS 


Chairman: H. L. Royden, Stanford University 

Papers: Symposium 

Discussion: 1. David Blackwell, Howard University and University of California 
2. Wendell A. Horning, Ramo Wooldridge Corporation 
3. E. T. Jaynes, Stanford University 
4. H. L. Royden, Stanford University 


4:00 p.m. Contributed Papers II 


Chairman: Edward W. Barankin, University of California 
Papers: 1. Detection and Hypothesis Testing by Linear Methods, Emanuel Parzen, 
Columbia University 
2. Probability of Indecomposability of a Set Under Random Mappings, 
Leo Katz, Michigan State College 
3. On the Near Monotonic Character of the Power Function of a Certain 
Multivariate Test, 8. N. Roy and K. V. Ramachandran, University 
of North Carolina 
. Simultaneous Distribution of the Mean, Standard Deviation, and Range 
jor Probability Density Functions of Doubly Infinite Range, Prelimi- 
rary Report, Melvin D. Springer, U. 8. Naval Ordnance 
. A Class of Asymptotic Tests of Composite Hypotheses, J. Neyman, 
University of California 
. The Transitions of a Markovian Process from Set to Set, Bayard Rankin, 
Massachusetts Institute of Technology 
. Confidence Intervals for the Ratio and for the Difference of T'wo Proba- 
bilities, Preliminary Report, R. R. Bahadur and W. H. Kruskal, 
University of Chicago 
. Limit Theorems for Conditional Distributions, G. P. Steck, University 
of California 
. Tests of Contagion and Time Effect in Accident Proneness, Preliminary 
Report, Howard Tucker, University of California 
. Chi Square Test of Goodness of Fit for a Class of Cases of Dependent 
Observations, Joseph Putter, University of California 
. Approximate Probability Values for Observed Number of Successes from 
Statistically Independent Binomial Events with Unequal Probabilities, 
John E. Walsh, Lockheed Aircraft Corporation. (By title) 


6:30 p.m. Dinner of Mathematicians and Statisticians— With Third Berkeley 
Symposium and Section A of AAAS 


Speaker: Charles B. Tompkins, University of California, Los Angeles 


4:00 p.m. 1955 Council Meeting 


President: Henry Scheffé, University of California, Berkeley 


T. A. JEEVES 
Assistant Secretary 





NEWS AND NOTICES 


MINUTES OF THE ANNUAL BUSINESS MEETING, 1954 


The meeting was called to order by President E. G. Olds at 7:30 P.M. in 
Room 117 Dwinelle Hall, University of California, Berkeley, California. 

The minutes of the business meeting of September 12, 1954 were read by the 
Secretary. The minutes were approved as read. 

Ballots for the election of a President-Elect, for the election of five members of 
the Council and for voting on an amendment to the Constitution were collected 
and the tellers retired to determine the results. The results were, after adjourn- 
ment of the business meeting, announced as follows: 

David Blackwell was elected President-Elect for 1955, President for 1956. 

R. L. Anderson, Leo Goodman, P. G. Hoel, L. J. Savage and Herbert Solomon 
were elected to the Council for the term January 1, 1955 to December 31, 1957. 

The motion to amend the constitution passed. The second paragraph of 
Article 9 of the constitution was thereby amended by replacing the phrase, ‘““‘The 
publications of the Institute” by “The publication of the official journal.”’ The 
wording of Article 9 is therefore: 


The Annals of Mathematical Statistics shall be the official journal of the Institute. Other 
publications may be authorized by the Council. 

The publication of the official journal shall be supervised by the Editor, with the as- 
sistance of the Associate Editors and such committees as the Council may approve. 


The Secretary reported the recommendation of the Council that the member- 
ship amend the first sentence of the fourth paragraph of Article 1 of the Bylaws 


by deleting the word “‘whether’’ and by deleting the phrase “‘or to other publica- 
tions”. The Secretary moved the adoption of this amendment. The motion was 
seconded and carried. The fourth paragraph of Article 1 of the Bylaws now 
therefore reads: 


The Editor, subject to the direction of the Council, shall have charge of all editorial 
matters relating to the official journal. He shall, with the advice and consent of the Council, 
appoint an Editorial Committee of not less than twelve members to cooperate with him 
for definite terms. All appointments to the Editorial Committee shall terminate with the 
appointment of a new Editor. 


The President submitted his report for the year 1954. 

The Secretary submitted his report for the year 1954.” 

The Treasurer submitted an informal report and announced that a formal 
report would be submitted after the close of the year. 

The Editor submitted his report for the year 1954.* 

The Program Coordinator submitted an informal report on plans for meetings 
during 1955. 

The incoming President was introduced and took the chair. He said it would 


1 The report of the President appears on page 179 in this issue of the Annals. 
2 The report of the Secretary appears on page 186 in this issue of the Annals. 
3 The report of the Editor appears on page 187 in this issue of the Annals. 
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be very difficult to meet the high standards set by his predecessor. He remarked 
that only the Executive Committee knew how much the retiring President had 
given of himself. He expressed their appreciation. 

President Scheffé called for any new business, 

After a very brief discussion of matters related to the business of the Institute, 


a motion to adjourn was made, seconded and carried and the meeting adjourned 
at 8:20 P.M. 


REPORT OF THE PRESIDENT OF THE INSTITUTE FOR 1954 


The names of the members, who have served the Institute in various official 
capacities during the past year, appear at the close of this report. To all these, 
and to the many other members who have given their unselfish help, I wish to 
express my deep appreciation on behalf of the Institute. Furthermore, I offer 
them my personal thanks for the aid, encouragement and sound advice they have 
given me. 

Because of the efforts of the above-mentioned members the Institute has con- 
tinued to fulfill its purposes as “‘a society for encouraging the development, dis- 
semination and application of mathematical statistics’, as set forth in its con- 
stitution. Our official journal has maintained and enhanced its high reputation. 
Excellent programs have been presented at our national meeting in Montreal 
and Berkeley, and at our sectional meetings in Ithaca, Gainesville, Pasadena and 
Iowa City. Committees have been exploring the opportunities for new activities 
which promise to be of help to our cause. The funds to support our various 
services have been carefully nurtured and our sound financial position has been 
buttressed by prudent investments. 

The above statement briefly summarizes the successful work of the Institute 
for 1954. The remainder of my report will supply more specific information re- 
garding the various contributions which helped to insure this success. 

As noted by M. H. Hansen in the President’s Report for 1953, the Editor and 
Secretary-Treasurer bear the brunt of the work of the Institute. While the 
Associate Editors and Cooperating Members of the Editorial Board richly 
deserve recognition, it must be clear to all that the major responsibility for the 
Annals belongs to E. L. Lehmann himself. In addition to this constant load, the 
Editor has served as an official member of several committees. 

K. J. Arnold carried two burdens, as the secretary and also as the treasurer; 
either one of these would have strained an ordinary person. Also, he has been 
a member of six committees, and as chairman of the Committee to Prepare a 
Manual for the Guidance of Officers he has made a signal contribution to the 
efficient operation of the Institute. Through his efforts the officers of the Institute 
have been supplied with a codification of Council actions and a description of 
the functions of standing committees, together with a list of past officers, Rietz 
lecturers and other official representatives, in a form for ready reference. 

This has been a year when the members of the Council should be publicly com- 
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mended for an unusual quantity and quality of labor on behalf of the Institute. 
In addition to their deliberation, at three formal meetings, Council members 
have been called upon to discuss and settle many matters by correspondence. 
Their prompt, yet careful, consideration of problems, which at times demanded 
almost daily attention, should not go unmarked. 

Leo Katz, the Program Coordinator, has been a member of all of the program 
committees, besides serving as Chairman of the Program Committee for the 
annual meeting. His unselfish contribution of time and energy deserves special 
recognition. 

D. B. DeLury, R. A. Bradley, D. A. Darling and T. E. Harris carried program 
responsibilities as chairmen for the Montreal meeting, and Eastern, Central and 
Western regional meetings respectively. Elizabeth Scott was vice-chairman for 
the meeting at Berkeley. For the success of the meetings in their respective 
areas, Associate Secretaries Lionel Weiss, William Kruskal and Evelyn Fix 
deserve much credit. Furthermore, the work of the various assistant Secretaries 
should not be overlooked. 

Discussion of meetings should include mention of the work of Leo Goodman’s 
Committee in arranging for special invited addresses and of the gratitude of the 
Institute to the men who delivered the addresses. The list for 1954 was as follows: 


Summer Meeting: W. Hoeffding, ‘‘Non-Parametric Large Sample Theory”’ 

Annual Meeting: H. Chernoff, ‘‘Large Sample Theory in the Parametric Case’”’ 

Annual Meeting: J. Neyman, ‘‘Probabilistic Treatment of Phenomena: Stochastic Models 
and Interpolatory Formulae.” 


(Arrangements for the last-mentioned address were made by the 1953 Committee.) 


The steady growth of the Institute is fostered by the work of the promotional 
committees. For his Committee on Individual Memberships, W. D. Baten re- 
ports the addition of 62 new members. 

Upon recommendation of the Rietz Lecture Committee, the Council approved 
the appointment of Will Feller as the next Rietz Lecturer. His lecture is planned 
for 1955. 

B. F. Kimball and his Committee on Professional Standards of Statisticians 
in Government Service are making a survey of required qualifications, salaries, 
and duties for this group. A comprehensive report is contemplated. 

The Editorial Committee for the Publication of Wald’s Selected Papers, under 
the chairmanship of T. W. Anderson, Jr. has completed its work and early 
publication by the McGraw-Hill Company has been scheduled. 

Late in 1953, J. Neyman agreed to take the chairmanship for a Committee to 
plan for a summer statistical institute. The report of this Committee was received 
and approved by the Council at the Montreal meeting. Following a recommenda- 
tion made in the report, a Committee was appointed to prepare detailed plans for 
a statistical institute to be held in the summer of 1955 at Berkeley. This Com- 
mittee, consisting of D. H. Blackwell, T. E. Harris, and H. E. Robbins, probably 
will be ready to report to the membership in the near future. 

In contrast to its condition in the lean years of youth, the Institute now finds 
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itself with a modest surplus for investment. The Treasurer, with the advice of 
Mortimer Spiegelman’s Finance Committee, has been making an effort to find 
sound and profitable repositories for all funds not needed for immediate expenses. 

Late in 1953, a Committee on Activities and Development was appointed with 
A. H. Bowker as Chairman. This Committee has proposed that the Institute 
cooperate in the publication of a series of statistical research monographs. 

Some of our members have expressed the wish that the scheduling of the annual 
meeting between Christmas and New Year’s could be avoided. C. C. Craig and 
his Committee to Explore the Desirability of Changing the Time of Winter 
Meetings are preparing a questionnaire on the subject for distribution to a 
sample of our membership. It might be mentioned that our desire to hold joint 
meetings with both mathematical and other statistical organizations severely 
restricts the independence of our actions. 

Early this year, the Secretary requested the appointment of a Committee to 
advise him on the adequacy of physical facilities for meetings. This Committee, 
with J. L. Hodges, Jr., as Chairman, has served its purpose well. 

Among the many duties of the incoming President, Henry Scheffé, has been 
his service as Chairman of a Committee to Re-examine the Constitution and 
By-Laws. Manifestations of the considerable work which has been accomplished 
probably will reach the membership in 1955. 

A Committee consisting of T. W. Anderson, Jr., Chairman; H. Cramér, W. 
Feller, M. A. Girshick, and S. 8. Wilks, was appointed to nominate the Editor of 
the Annals for the term of 1956--58. The election of the new editor by the Council! 
must take place well in advance of the beginning of his term of office so that he 
and his staff may begin work on manuscripts. I am very happy to report that the 
committee was able to persuade the present editor, E. L. Lehmann, to accept 
nomination for another term. He was duly re-elected by the Council at the 
Montreal meeting. 

P. S. Dwyer, Chairman; W. E. Deming, and Churchill Eisenhart were ap- 
pointed as members of a Committee to nominate a Secretary and a Treasurer 
to succeed Kenneth J. Arnold, whose term as Secretary-Treasurer expires June 
30, 1955. Over the years, the work of the combined office has so increased that it 
now seems necessary to take advantage of the constitutional provision which 
permits separate officers. Upon nomination by Professor Dwyer’s Committee, 
the 1954 Council, at its Berkeley meeting, elected George E. Nicholson, Jr., as 
Secretary and Albert H. Bowker as Treasurer. The terms for both officers are 
for the period, July 1, 1955 to June 30, 1958. 

As usual, our official representatives have been effective. Harold Hotelling is 
completing his term in the Council of the American Association for the Advance- 
ment of Science. 8. 8. Wilks has been appointed to a further three-year term on 
the Division of Mathematics, National Research Council, by President Bronk of 
the National Academy of Sciences. W. G. Madow and T. W. Anderson, Jr., are 
completing another year of helpful service on the Inter-Society Committee on the 
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Mathematical Training of Social Scientists. It should be noted that Professor 
Madow accepted the responsibility for organizing this successful Committee and 
has served as its chairman from the beginning. 

J. C. R. Li was asked to represent the Institute at the inauguration of Owen 
Meredith Wilson as President of the University of Oregon. 

The following members served as official delegates from the Institute to the 
International Congress of Mathematicians at Amsterdam: 


D. H. Blackwell 
J. Neyman 

H. E. Robbins 
C. Stein 

8. S. Wilks 


Upon nomination by the Committee on Fellows, the Council elected the follow- 
ing persons as Fellows of the Institute: 


2. R. Bahadur 
H. E. Daniels 
D. A. Darling 
D. A. 8. Fraser 
L. M. LeCam 


The following persons have been appointed to serve on the Nominating Com- 
mittee for 1955: 


W. J. Dixon, Chairman H. B. Mann 
M. A. Girshick H. Nisselson 
M. G. Kendall A. W. Tucker 


Committees of the Institute, 1954 


I. The Council and Committees of the Council. 
(a) Elected members of the Council 
Term expires 1954 Term expires 1955 
A. H. Bowker W. G. Cochran 
T. C. Koopmans Churchill Eisenhart 
H. E. Robbins Henry Scheffé 
H. G. Romig J. W. Tukey 
Term expires 1956 
T. W. Anderson, Jr. 
Joseph Berkson 
Z. W. Birnbaum 
D. H. Blackwell 
W. G. Madow 
(b) Executive Committee 
E. G. Olds, President 
Henry Scheffé, President-Elect 
K. J. Arnold, Secretary-Treasurer 
E. L. Lehmann, Editor 
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(c) Committee on Fellows 
Term expires 1954 
Gerhard Tintner 
8S. 8S. Wilks, Chairman 
Term expires 1956 
D. H. Blackwell 
Howard Levene 
(d) Associate Secretaries 
Evelyn Fix, Western Region 
W. H. Kruskal, Central Region 
Lionel Weiss, Eastern Region 
(e) Associate Treasurer 
E. 8. Pearson 
(f) Associate Editors 
D. H. Blackwell 
H. E. Daniels 
J. L. Hodges, Jr. 
J. Wolfowitz 


II. Editorial Committee 
(a) E. L. Lehmann, Editor, Chairman 
(b) Associate Editors listed immediately above 
(c) Cooperating members 
Z. W. Birnbaum 
R. C. Bose 
Herman Chernoff 
K. L. Chung 
J. F. Daly 
D. A. Darling 
J. L. Doob 
T. E. Harris 
P. G. Hoel 
J. Kiefer 
W. H. Kruskal 
Soloman Kullback 


III. Committees Related to Program 

(a) Annual Meeting—Berkeley 
Leo Katz, Chairman 
Elizabeth L. Scott, V. Chr. 
Evelyn Fix, Assoc. Secy. 
J. A. Jeeves, Asst. Secy. 
Z. W. Birnbaum 
D. H. Blackwell 

(b) September Meeting—Montreal 
D. B. DeLury, Chairman 
Lionel Weiss, Assoc. Secy. 
Roger Lessard, Asst. Secy. 
R. L. Anderson 
I. W. Burr 


Term expires 1955 


W. G. Madow 
Edward Paulson 


Wassily Hoeffding 
W. G. Madow 
A. M. Mood 


H. B. Mann 

G. E. Noether 
Edward Paulson 
M. P. Peisakoff 
H. E. Robbins 
S. N. Roy 

L. J. Savage 
Herbert Solomon 
C. M. Stein 
Lionel Weiss 

M. A. Woodbury 


D. G. Chapman 
M. A. Girshick 
T. E. Harris 

G. B. Price 
Mina Rees 

F. F. Stephan 


G. J. Lieberman 
W. E. Patte 
Howard Raiffa 
R. G. D. Steel 
D. J. Thompson 
D. F. Votaw 
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(c) Eastern Region 
R. A. Bradley, Chairman 
Lionel Weiss, Assoc. Secy. 
I. Blumen, Asst. Secy. 
H. A. Meyer, Asst. Secy. 
I. J. D. Bross 

(d) Central Region 
D. A. Darling, Chairman 
W. H. Kruskal, Assoc. Secy. 
A. T. Craig, Asst. Secy. 
John Gurland 


Glenn Burrows 
Max Halperin 

J. E. Jackson 

J. Kiefer 

xottfried Noether 


A. W. Kimball 
Ingram Olkin 
Murray Rosenblatt 
W. F. Taylor 
Henry Teicher 
(e) Western Region 
T. E. Harris, Chairman 
L. A. Aroian, Asst. Secy. 
W. J. Dixon 
J. L. Hodges, Jr. 
(f) Program Coordinator (Ex-officio member of all Program Committees) 
Leo Katz 
(g) Special Invited Papers 
L. A. Goodman, Chairman 
T. W. Anderson, Jr. 
D. H. Blackwell 
R. A. Bradley 
D. A. Darling 


S. W. Nash 
H. Rubin 
D. Teichroew 


D. B. DeLury 

T. E. Harris 

Leo Katz 

E. L. Lehmann (Ex-Officio) 
P. R. Rider 


IV. Promotional Committees 
(a) Individual Memberships 


W. D. Baten, Chairman M. R. Mickey, Jr. 


Evelyn Fix 

E. L. Kaplan 
E. 8. Keeping 
O. E. Lancaster 


(b) Academic Institutional Memberships 


T. A. Bancroft, Chairman 
A. C. Cohen, Jr. 

G. B. Dantzig 

P. C. Hammer 


(c) Non-Academic Institutional Membership 


H. G. Romig, Chairman 
C. A. Bennett 

M. A. Brumbaugh 

A. V. Feigenbaum 

R. P. Gage 


E. W. Pike 
M. E. Wescott 
Sigmund Zobel 


Boyd Harshbarger 
L. A. Knowler 

E. B. Mode 

F. M. Weida 


F. J. Halton, Jr. 
E. P. King 

C. E. Noble 

P. 8. Olmstead 


V. Other Committees 
(a) Nominating Committee 
Appointed by 1953 President M. H. Hansen 


Max Woodbury, Chairman 
Walter Bartky 
R. A. Bradley 


Edward Paulson 
George Kuznets 
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(b) Rietz Lecture Committee 
J. Neyman, Chairman 
Harald Cramér 
Harold Hotelling 
(c) Professional Standards of Statisticians in Government Service 
B. F. Kimball, Chairman A. 8. Householder 
K. A. Brownlee George Kuznets 
R. W. Burgess Joseph Lev 
Besse B. Day Herbert Marhsall 
Churchill Eisenhart R. E. Patton 
G. M. Harrington J. E. Walsh 
P. G. Homeyer 
(d) Editorial Committee for the publication of Wald’s Selected Papers 
T. W. Anderson, Jr., Chairman E. J. Lehmann 
Harald Cramér J. L. Hodges, Jr. 
H. A. Freeman A. M. Mood 
C. M. Stein 
(e) Planning Committee for Summer Statistical Institute 
J. Neyman, Chairman W. G. Madow 
T. W. Anderson, Jr. F. C. Mosteller 
Z. W. Birnbaum H. A. Meyer 
D. H. Blackwell G. E. Nicholson 
J. L. Doob M. Rosenblatt 
W. Feller M. Sobel 
J. Gurland C. M. Stein 
R. M. Thrall 
(f{) Committee to Prepare Manual for Guidance of Officers 


K. J. Arnold, Chairman 
P. 8. Dwyer 
M. A. Girshick 


M. H. Hansen 
E. G. Olds 
Henry Scheffé 


(g) Advisory Committee on Statistical Computations 
Z. W. Birnbaum, Chairman 
A. H. Bowker 


Churchill Eisenhart 
C. C. Craig 


(h) Committee on Exchanges 
P. 8. Dwyer, Chairman 
K. J. Arnold (Ex-Officio) 
E. L. Lehmann (Ex-Officio) 
(i) Finance Committee 
Mortimer Spiegelman, Chairman 
C. H. Fischer 
K. J. Arnold 
(j) Committee on Activities and Development 
A. H. Bowker, Chairman 
R. C. Bose 
G. W. Brown 
J. H. Curtiss 
W. E. Deming 
K. W. Halbert 
(k) Committee on Committee Procedures 
H. E. Robbins, Chairman 
K. J. Arnold 
Z. W. Birnbaum 


H. O. Hartley 
E. L. Lehmann 
E. 8. Marks 
Frank Riordan 
H. E. Robbins 


J. H. Curtiss 
H. W. Norton 
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(1) Committee to Explore the Desirability of Changing Time of Winter Meetings 
C. C. Craig, Chairman C. F. Kossack 
R. L. Anderson R. B. Murphy 
J. L. Hodges, Jr. 
(m) Advisory Committee on Physical Facilities for Meetings 
J. L. Hodges, Jr., Chairman 
Leo Katz (Program Co-ordinator) 
G. E. Nicholson 
(n) Committee to Re-examine the Constitution and By-Laws 
Henry Scheffé, Chairman W. G. Cochran 
T. W. Anderson, Jr. Arnold Court 
K. J. Arnold (Ex-Officio) T. C. Koopmans 


8S. 8. Wilks 
(o) Committee to Nominate an Editor 


T. W. Anderson, Jr., Chairman M. A. Girshick 
H. Cramér S. S. Wilks 
W. Feller 
(p) Committee to Nominate a Secretary and a Treasurer 
P. 8. Dwyer, Chairman 
W. E. Deming 
C. Eisenhart 
(q) Committee to Organize and Conduct the 1955 Summer Statistical Institute 
D. H. Blackwell, Chairman 
J. E. Harris 
H. E. Robbins 


Representatives of the Institute for 1954 


To the American Association for the Advancement of Science 
Harold Hotelling (Term expires December 31, 1954) 
To the National Research Council, Division of Mathematics 
S. 8. Wilks (Term expires June 30, 1957) 
To the Policy Committee for Mathematics 
Joseph F. Daly (Term expires December 31, 1954) 
On the Committee on Mathematical Training of Social Scientists 
W. G. Madow and T. W. Anderson, Jr. 
On the Committee on Establishing a Classification List of Specialties in Mathematics for the 
National Science Foundation 
Benjamin J. Tepping 
December 29, 1954 Edwin G. Olds 
President 


REPORT OF THE SECRETARY-TREASURER OF THE INSTITUTE 
FOR 1954 


The individual membership in the Institute increased from 1399 at the end of 
1953 to 1512 at the end of 1954, a net increase of 113 individual members. During 
the year there was one death, 17 resignations, 40 members dropped for nonpay- 
ment of dues, 18 reinstated on payment of dues for previous years and 163 new 
members accepted. The work of the Membership Committee, in inviting indi- 
viduals presumably interested in mathematical statistics to apply for membership 
in the Institute, was responsible for a large share of the new members. Of the 
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1512 individual members at the end of 1954, 442 were in the special categories set 
up by the bylaws: 232 were members whose permanent residence is outside the 
United States and Canada, 185 were student members, 12 were nominees of 
institutional members, 8 were husband-wife members, 3 were retired from active 
service and 2 were on active military duty. 

The number of institutional members increased from 9 at the end of 1953 to 
12 at the end of 1954 with the enrollment of the Statistical Laboratory of the 
State College of Iowa, the Department of Mathematics of Michigan State Col- 
lege, and the State University of Iowa. Our institutional members are very much 
appreciated both because of their financial support of the expending program of 
the Institute and because of the approval of the activities and aspirations of the 
Institute, which the officers of the Institute believe is implied by this financial 
support. 

During 1954 the Institute held its 59th through 64th meetings. These meetings 
have been reported in the Annals except for the last two, reports of which 
will appear in the same issue of the Annals as will this report. Business meet- 
ings were held during the 62nd (16th Summer) meeting and the 64th (17th 
Annual) meeting. The report of the first of these appeared in the December 
Annals and the report of the second will appear in the same issue of the 
Annals as will this report. The Program Committees are to be congratulated 
on the excellent programs which have been arranged under the immediate direc- 
tion of R. A. Bradley, T. E. Harris, D. B. DeLury, Leo Katz and Elizabeth Scott 
with the overall guidance of our Program Coordinator Leo Katz. The full mem- 
bership of the Program Committees is given in the President’s report. The As- 
sistant Secretaries Isadore Blumen, H. A. Meyer, L. A. Aroian, Roger Lessard, 
A. T. Craig and T. A. Jeeves are to be congratulated on the physical arrange- 
ments and the Associate Secretaries Lionel Weiss, W. H. Kruskal and Evelyn 
Fix on their performance of the duties of the Secretary with respect to these 
meetings. 

In November a directory was issued with information obtained from members 
up to October 15, 1954. The information given is more complete than has been 
available in directories of the Institute for many years. 

It has been usual in the past to have the reports of the Secretary and of the 
Treasurer submitted at the same time. This year the Treasurer suggested and 
the Executive Committee agreed that the auditor’s report should be transmitted 
to the membership and that the Treasurer’s report should be delayed until these 
two reports could be submitted together. The Treasurer’s report for 1954 should 
therefore appear in the June, 1955 issue of the Annals. K. J. ARNOLD 

Secretary 


REPORT OF THE EDITOR OF THE ANNALS FOR 1954 


The 1954 volume of the Annals contained 53 papers and 23 notes. Together 
with the usual reports, abstracts, and news and notices this brought the total 
number of pages printed to 826. While this is an increase of more than 100 pages 
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over the previous volume, the number of papers submitted during the year 
showed a decrease for the first time in many years. 

_ The special invited paper published this year was by J. Wolfowitz: ““Estima- 
tion by the Minimum Distance Method in Nonparametric Stochastic Difference 
Equations”’. 

On behalf of the Editorial board, the Editor takes the opportunity to acknow]l- 
edge the generous refereeing assistance of the following: G. E. Albert, T. W. 
Anderson, F. J. Anscombe, R. E. Bechhofer, Joseph Berkson, Max A. Bershad, 
Julius Blum, G. E. P. Box, A. H. Bowker, A. C. Cohen, W. C. Connor, D. R. 
Cox, C. C. Craig, Monroe Donsker, Meyer Dwass, B. Epstein, D. A. S. Fraser, 
M. A. Girshick, Leo Goodman, Ulf Grenander, John Gurland, J. M. Hamm *s- 
ley, Morris H. Hansen, L. H. Herbach, William N. Hurwitz, T. A. Jeeves, Leo 
Katz, D. G. Kendall, L. LeCam, Eugene Lukacs, F. J. Massey, Lincoln Moses, 
F. Mosteller, W. L. Nicholson, E. 8. Pearson, C. R. Rao, Murray Rosenblatt, 
I. R. Savage, Henry Scheffé, Elizabeth Scott, Monroe G. Sirken, Rosedith 
Sitgreaves, Milton Sobel, George Steck, and W. F. Taylor. 

The Editor is greatly indebted to Arnold Court and Mrs. Joanne Hand for 
preparing the manuscripts for the printer and providing other editorial as- 
sistance. 

E. L. LEHMANN 
Editor 


December 29, 1954. 


PUBLICATIONS RECEIVED 


GNEDENKO, B. V. anp A. N. Kotmoacorov, Limit Distributions for Sums of Independent 
Random Variables, Addison-Wesley Publishing Co., Inc., Cambridge, 1954, ix + 264 
pp., $7.50. 

Naval Research Logistics Quarterly, Vol. 1, No. 1, March, (1954), Office of Naval Research, 
U. 8. Government Printing Office, 74 pp. 

JENSEN, ARNE, A Distribution Model, Munksgaard, Copenhagen, 1954, 99 pp. 

Kern, Lawrence R., Georce Katona, Joun B. LANSING AND JAMES N. Moraan, Con- 
tributions of Survey Methods to Economics, Columbia University Press, New York, 
1954, 269 pp., $5.00. 

Masvuyrama, M., Graphical Method of Statistical Inference, Maruzen Co., Ltd., Tokyo, 83 
pp., $2.50. 

Kewney, J. F. anp E. 8. Kerepine, Mathematics of Statistics, Part I, D. Van Nostrand 
Company, Inc., Toronto, New York, London, Third Edition, 1954, xii + 346 pp. 
Axspe.-Arty, S. H., ‘““Tables of Generalized k-Statistics’’, Vol. 41, parts 1 and 2, Biometrika, 
Statistical Table No. XIX, Cambridge University Press, 1954, 8 pp., 2 shillings. 
Contributions to the Solution of Systems of Linear Equations and the Determination of Eigen- 
values, edited by Olga Taussky, National Bureau of Standards Applied Mathematics 
Series 39, 139 pp., $2.00. (Order from the Government Printing Office, Washington 25, 

D. C.) 

Koyck, L. M., Distributed Lags and Investment Analysis, North-Holland Publishing Co., 

Amsterdam, 1954, v + 111 pp., $2.75. 





ESTADISTICA 


Journal of the Inter American Statistical Institute 


Volume XIII, No. 46 Contents March 1955 
Contribuicio ao Estudo das Atividades Econémicas da Populacao Brasileira 

Ovip10 DE ANDRADE JONIOR 
Sintesis Panordmica de la Situaci6n Demogrdfica de Bolivia: Censo Nacional de 1950 


ASTHENIO AVERANGA 
Sampling for Agricultural Data....... ........WALTER A. HENDRICKS 


La Integracién Estadistica Regional como Elemento de Coordinacién Econémica 
Omar Denco O. 
Necesidades Inmediatas y Mediatas en Estadisticas Vitales y Sanitarias en Pafses de Distinto 
Nivel de Desarrollo .... HERNAN RomERO y JERJES Vitp6sOLA 
The Use of Hospital Statistics to Study Morbidity in the Community 
SUBCOMMITTEE ON Hosprtat STATISTICS 
Posibilidades y Peligros de la Utilizacién del Aparato MatemiAtico en la Economfa (traducci6n) 


M. ALLAIs 
La Exactitud de los Resultados Censales (traduccién) 


Morris H. Hansen, Witt1am N. Hurwitz y LEON PRITZKER 
Needs for Analytical Studies of Census Data—Necesidades de Estudios Analiticos de los 
Datos Censales 


Utilizaci6n de los Censos para Probar la Integralidad del Registro de Nacimientos 


Rogue Garcfa-FrR1as 
Institute Affairs. Statistical News. Publications. 


Published quarterly Annual subscription price $3.00 (U. S.) 


INTER AMERICAN STATISTICAL INSTITUTE 


Pan American Union 
Washington 6, D.C. 


THE AMERICAN STATISTICAL ASSOCIATION 


announces the publication of two new monographs: 


Statistical Problems of the Kinsey Report 


by CocHRAN, MOSTELLER and Tukey. The evaluation of the statistical methodology used by 
Kinsey and his associates in their first volume. This study was requested by the Committee 
for Research in the Problems of Sex of the National Research Council, which is sponsoring 
Dr. Kinsey’s work. The contents include Statistical Problems of the Kinsey Report, Dis- 
cussion of comments by Selected Technical Reviewers, Comparison with Other Studies, Pro- 
posed Further Work, Probability Sampling Considerations, The Interview and The Office, 
Desirable Accuracy, Principles of Sampling. 

The monograph contains 331 pages, plus a foreword, preface and index; bound in blue 
buckram; $3.00 to ASA members; $5.00 to others. 


Proceedings of the Business and Economics Statistics Section. 


The papers given at the sessions sponsored by the Business and Economics Statistics Section 
at the Annual Meeting of the American Statistical Association in Montreal in September 
1954. This volume contains papers on Pension Funds, Business Outlook, International Pay- 
ments, Consumer Survey Data, Forecasting, Employment and Unemployment Statistics, 
Stock Market, Government Statistics, Measurement of Saving and Investment, Mobilization, 
Productivity. 
Approximately 250 pages, paper bound. Price $2.00 to ASA members; $3.00 to others. 

Copies may be ordered directly from the AMERICAN STATISTICAL AssOcIATION, 1108 Sixteenth 
Street, N. W., Washington 6, D. C. 





ECONOMETRICA 


Journal of the Econometric Society 
Contents of Vol. 23, No. 1 - January, 1955 


W. HAMBURGER:........... The Relation of Consumption to Wealth and the Wage Rate 
F. V. WauGH anp G. L. Burrows:................./ A Short Cut to Linear Programming 
D. DurRAND:.. .Bank Stocks and the Analysis of Covariance 


F. Mopic.iani AND F. E. Houn: Production Planning Over Time and the Nature of the 
Expectation and Planning Horizon 


On a Modification of the Variate-Difference Method 
Bottleneck Problems, Functional Equations, and Dynamic Programming 
Economic Implications of Some Cotton Fertilizer Experiments 


Report on the Pasadena Meeting 
Book Reviews, Notes and Announcements 


Published Quarterly Subscription rates available on request 


The Econometric Society is an international society for the advancement of economic theory in its 
relation to statistics and mathematics 


Subscriptions to Econometrica and inquiries about the work of the Society and the procedure in applying 
for membership should be addressed to Richard Ruggles, Secretary, The Econometric Society, Box 
1264, Yale University, New Haven, Connecticut. 


BIOMETRIKA 


Volume 41 Contents Parts 3 and 4, December 1954 


The Design of an Experiment in which Certain Treatment Arrangements Are Inadmissible. D. R. COX. 
The Estimation of Location and Scale Parameters from Grouped Data. J. M, HAMMERSLEY and K. W, 
MORTON. Transformations of the Binomial, Negative Binomial, Poisson and x*Distributions. G. 
BLOM. A Quickly Convergent Expansion for Cumulative Hypergeometric Probabilities, Direct and In- 
verse. M.E. WISE. Quotient of a Rectangular or Triangular and a General Variate. 8.R. BROADBENT. 
An Estimation Problem in Quantitative Assay. J. AITCHISON and J. A.C. BROWN. The Use of the 
Hankel Transform in Statistics. II. Methods of Computation. R. D. LORD. A Reduction Formula for 
Normal Multivariate Integrals. R.L. PLACKETT. On the Comparison of Two Means: A Further Dis- 
cussion of Iterative Methods for Calculating Tables. W.H. TRICKETT and B.L.WELCH. Some Further 
Results in the Theory of Pedestrians and Road Traffic. A.J. MAYNE. Bias in the Estimation of Auto- 
correlation. F. H.C. MARRIOTT and J. A. POPE. Note on Bias in the Estimation of Autocorrelation. 
M. G. KENDALL. Teste of Hypotheses in the Linear Autoregressive Model. Part I. G. M. JENKINS. 
Some Problems of Optimum Sampling. P.N.SOMERVILLE. A Test for Markoff Chains. P. G. HOEL. 
The Distribution of Range in Certain Non-normal Populations. H.A. DAVID. The Mean and Coefficient 
of Variation of Range in Small Samples from Non-normal Populations. D. R.COX. The Distribution of 
the Ratio, in a Single Normal! Sample, of Range to Standard Deviation. H. A. DAVID, H.O. HARTLEY 
and E. 8. PEARSON. Sampling with Control Variables. E.C. FIELLER and H.O. HARTLEY. The 
Goodness of Fit of Frequency Distributions Obtained from Stochastic Processes. V. N. PATANKAR. 
On Stationary Processes in the Plane. P. WHITTLE. Rank Analysis of Incomplete Block Designs. II. 
Additional Tables for the Method of Paired Comparisons. R.A. BRADLEY 


The subscription price, payable in advance, is 45s. inland, 54s. export (per volume including postage) Cheques 
should be drawn to Biometrika and sent to “The Secretary. Biometrika Office, Department of Statistics, 
University College. London, W.C. 1.” All foreign cheques must be in sterling and drawn on a bank 
having a London agency 





MATHEMATICAL REVIEWS 


A journal containing reviews of the mathematical liler- 
ature of the world, with full subject and author indices 


Publication of this journal is sponsored by the American Mathe- 
matical Society, Mathematical Association of America, Institute of 
Mathematical Statistics, London Mathematical Society, Edinburgh 
Mathematical Society, Union Matematica Argentina, and others. 


Subscriptions accepted to cover the calendar year only. 
Issues appear monthly except July. $20.00 per year. 


Send subscription order or request for sample copy to 


AMERICAN MATHEMATICAL SOCIETY 
80 Waterman Street, Providence 6, Rhode Island 


JOURNAL OF THE 
ROYAL STATISTICAL SOCIETY 


Series B (Methodological) 

Vol. XVI, No. 1, 1954 
F. G. Foster AND A. STUART Distribution-free Tests in Time-Series Based on the 
Breaking of Records (with Discussion) 
J. M. Hammerstey AND K. W. Morton......Symposium on Monte Carlo Methods: 
Poor Man’s Monte Carlo. 
K. D. TocHER The Application of Automatic Computers to Sampling Experiments 
(with Discussion) 
J. M. HAMMERSLEY AND K. W. Morton .Transposed Branching Processes 
N. T. J. BatLey On Queueing Processes with Bulk Service 
J. H. BENNETT The Distribution of Heterogeneity upon Inbreeding 
CHARLOTTE BANKS The Factorial Analysis of Crop Productivity 
P. A. P. Moran Some Experiments on the Prediction of Sunspot Numbers 
L. MANDEL Grading with a Gauge Subject to Random Output Fluctuations 
Control Charts for the Mean of a Normal Population 
An Improvement to Wald’s Approximation for Some Properties of 
Sequential Tests 
H. D. PATTERSON The Errors of Lattice Sampling 


The Royal Statistical Society, 21, Bentinck Street, Lonaon, W. 1 





SKANDINAVISK 
AKTUARIETIDSKRIFT 


1953 - Parts 3 - 4 
Contents 


Ertrx SparRE ANDERSEN. .... On Sums of Symmetrically Dependent Random 
Variables 

D. R. Cox anp Wattsr L. Smiru......A Direct Proof of a Fundamental Theorem 
of Renewal Theory 

GustaF BorENIUS On the Statistical Distribution of Mine Explosions 
Baner Uitte. 2) >... F200. An Extremal Problem in Mathematical Statistics 
Brrcer MEIDELL Randbemerkungen zum Landréschen Maximum 
Ur GRENANDER AND Murray RosENBLATT....Comments on Statistical Spectral 
Analysis 

GuUNNAR BENKTANDER....On the Variation of the Risk Premium with the Dimen- 


sions of the House within Fire Insurance 
Litteraturanmialningar 


Eksamen i Forsikringsvidenskab og Statistik ved Kgbenhavns Universitet 
Tentamensproblem och évningsuppgifter i forsikringsmatematik vid Stockholms 


Hégskola fér betyget AB 
Oversikt av utlindska aktuarietidskrifter 


Annual subscription: $5.00 per year 
Inquiries and orders may be addressed to the Editor. 
GRANHALLSVAGEN 35, STOCKSUND, SWEDEN 


SANKHYA 


The Indian Journal of Statistics 
Edited by P. C. Mahalanobis 


Vol. 14, Part 3, 1954 


MorosaBuro MasvyaMA......On the Error in Crop Cutting Experiment Due to the Bias 
on the Border of Grid 
P. B. Patnark......A Test of Significance of a Difference Between Two Sample Proportions 
When the Proportions are Very Small 
J. Roy.. On Some Tests of Significance in Samples From Bi-Polar Normal Distributions 
I. M. CHAKRAVARTI On the Problem of Planning a Multistage Survey for Multiple 
Correlated Characters 
National Sample Survey: Unemployment Survey in Delhi 
National Sample Survey: Some Aspects of the Sample Design 


ANNUAL SusscripTion: 30 rupees ($10.00), 10 rupees ($3.50) per issue. 
Bacx Numsers: 45 rupees ($15.00) per volume; 12/8 rupees ($4.50) per issue. 
Subscriptions and orders for back numbers should be sent to 
STATISTICAL PUBLISHING SOCIETY 
204/1 Barrackpore Trunk Road Calcutta 35, India 








